00000001:02000400:0.0F:1787892749.196113:0:2960:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg229-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1787892770.996151:0:3182:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg229-server.virtnet: executing load_modules_local 00000001:01000000:1.0F:1787892773.478487:0:3242:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 386 MB/s 00000001:01000000:3.0F:1787892773.729946:0:3242:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 390 MB/s 00000001:01000000:2.0:1787892773.979935:0:3242:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 2235 MB/s 00000020:02000000:1.0:1787892775.592526:0:3274:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_84_ga3423c7 00000400:02000000:1.0:1787892776.919117:0:3289:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.202.129@tcp [8/256/0/180] 00008000:02000000:2.0:1787892780.327664:0:3439:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1787892833.101700:0:5246:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg229-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787892844.495129:0:5829:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787892844.495269:0:5829:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1787892844.495408:0:5829:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000094276459 00000080:02000400:2.0:1787892844.495421:0:5829:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1787892844.515274:0:5829:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1787892844.515289:0:5829:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787892844.515327:0:5829:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000067544309) 00000020:00000080:2.0:1787892844.515348:0:5829:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787892844.552658:0:5829:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1787892844.553398:0:5829:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1787892844.593115:0:5829:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1787892844.593154:0:5829:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787892844.593190:0:5829:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1787892844.593242:0:5829:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1787892844.593265:0:5829:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1787892844.596162:0:5829:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1787892844.596189:0:5829:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787892844.596206:0:5829:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x825e3f5022b4a373 00000020:01000004:1.0:1787892844.596217:0:5829:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1787892844.596223:0:5829:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1787892844.596229:0:5829:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000094276459 from MGS 00000020:01000004:1.0:1787892844.596234:0:5829:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1787892844.596274:0:5829:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000091b6c2a1) 00000020:00000080:1.0:1787892844.596288:0:5829:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1787892844.596399:0:5829:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000094276459 from MGS, refs=2 00080000:01000000:1.0:1787892844.596407:0:5829:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787892844.596412:0:5829:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x825e3f5022b4a381 00000100:00100000:1.0:1787892844.596562:0:5829:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1787892844.597677:0:5829:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1787892844.597690:0:5829:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787892844.598386:0:5829:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787892844.598402:0:5829:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787892844.599644:0:5829:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787892844.600010:0:5829:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787892844.600017:0:5829:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787892844.601256:0:5829:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787892844.601267:0:5829:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1787892844.604101:0:5829:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787892844.604123:0:5829:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787892844.605323:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892844.605328:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892844.605330:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892844.605637:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892844.605639:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892844.605641:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892844.606870:0:5829:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787892844.613152:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1787892844.855900:0:5829:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2107 MB/s 00000001:01000000:2.0:1787892845.105885:0:5829:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3331 MB/s 00000001:01000000:3.0:1787892845.355856:0:5829:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 451 MB/s 00000001:01000000:3.0:1787892845.606649:0:5829:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 587 MB/s 00080000:10000000:3.0:1787892845.623608:0:5829:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:1.0:1787892845.644274:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787892845.651287:0:5829:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1787892845.651323:0:5829:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787892845.651325:0:5829:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1787892845.657350:0:5839:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787892845.657525:0:5829:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787892845.657589:0:5829:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1787892845.657908:0:5829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1787892845.657936:0:5829:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1787892845.658504:0:5829:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787892845.659264:0:5829:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1787892845.659273:0:5829:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787892845.666118:0:5829:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787892845.666141:0:5829:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787892845.666551:0:5829:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787892845.666558:0:5829:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787892845.667195:0:5829:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787892845.667215:0:5829:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.129@tcp' 00000020:01000004:0.0:1787892845.667217:0:5829:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787892845.667264:0:5829:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.129@tcp (typ=mgc) 00000020:00000080:0.0:1787892845.667284:0:5829:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.129@tcp (0000000028e0b499) 00000020:00000080:0.0:1787892845.667312:0:5829:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787892845.667448:0:5829:0:(ldlm_lib.c:102:import_set_conn()) imp 000000003f1fee57@MGC192.168.202.129@tcp: add connection 192.168.202.129@tcp at head 00010000:00010000:0.0:1787892845.667607:0:5829:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.129@tcp-0 is initialized 00000040:01000000:0.0:1787892845.667612:0:5829:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.129@tcp ctxt 1 is initialized 00000100:00080000:1.0:1787892845.670603:0:5844:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1787892845.674915:0:5846:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787892845.675000:0:5829:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.129@tcp (uuid 22d910cf-711e-44e0-9acf-212404ada550) 00000020:00000080:1.0:1787892845.675023:0:5829:0:(genops.c:1385:class_connect()) connect: client 22d910cf-711e-44e0-9acf-212404ada550, cookie 0x825e3f5022b4a38f 00000100:00080000:1.0:1787892845.675037:0:5829:0:(import.c:510:import_select_connection()) MGC192.168.202.129@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787892845.675043:0:5829:0:(import.c:624:import_select_connection()) MGC192.168.202.129@tcp: import 000000003f1fee57 using connection 192.168.202.129@tcp/0@lo 00000100:00100000:1.0:1787892845.675095:0:5829:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007dfa2c02 x1874741455487104/t0(0) o250->MGC192.168.202.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787892845.675123:0:5829:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 22d910cf-711e-44e0-9acf-212404ada550->MGS 00000020:01000004:1.0:1787892845.675150:0:5829:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787892845.675155:0:5829:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1787892845.675176:0:5829:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000f8245bd7) 00000020:00000080:1.0:1787892845.675189:0:5829:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787892845.676457:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007dfa2c02 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:22d910cf-711e-44e0-9acf-212404ada550:3304:1874741455487104:0@lo:250: 00000100:00100000:0.0:1787892845.676535:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892845.676608:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455487104 00000100:00100000:0.0:1787892845.676616:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455487104 00000100:00100000:0.0:1787892845.676645:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787892845.676651:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003bbc0204 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3304:x1874741455487104:12345-0@lo:250: 00010000:00080000:0.0:1787892845.676690:0:5841:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 22d910cf-711e-44e0-9acf-212404ada550@0@lo t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:0.0:1787892845.676718:0:5841:0:(genops.c:1385:class_connect()) connect: client 22d910cf-711e-44e0-9acf-212404ada550, cookie 0x825e3f5022b4a39d 00000100:00080000:0.0:1787892845.676879:0:5841:0:(import.c:65:import_set_state_nolock()) 0000000077e81b12 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787892845.676932:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003bbc0204 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+5:3304:x1874741455487104:12345-0@lo:250: Request processed in 280us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892845.676940:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787892845.676980:0:3304:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.129@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787892845.676987:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.129@tcp: connect to target with instance 0 00000100:00080000:0.0:1787892845.676993:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.129@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787892845.676997:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787892845.677005:0:3304:0:(import.c:65:import_set_state_nolock()) 000000003f1fee57 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787892845.677008:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787892845.677015:0:3304:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787892845.677020:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007dfa2c02 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:22d910cf-711e-44e0-9acf-212404ada550:3304:1874741455487104:0@lo:250: 00000100:00100000:1.0:1787892845.703051:0:5829:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787892845.703915:0:5829:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1787892845.703922:0:5829:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1787892845.705218:0:5829:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1787892845.705229:0:5829:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787892845.705734:0:5829:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787892845.705749:0:5829:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787892845.711336:0:5829:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787892845.711542:0:5829:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787892845.711549:0:5829:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1787892845.713601:0:5829:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1787892845.713615:0:5829:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787892845.785893:0:5829:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787892845.786237:0:5829:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787892845.786246:0:5829:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787892845.788012:0:5829:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1787892845.788027:0:5829:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787892845.789117:0:5829:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787892845.789433:0:5829:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787892845.789439:0:5829:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787892845.790256:0:5829:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787892845.790264:0:5829:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787892845.790911:0:5829:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787892845.791091:0:5829:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787892845.791096:0:5829:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787892845.792110:0:5829:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787892845.792118:0:5829:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1787892845.792925:0:5829:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787892845.793110:0:5829:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787892845.793115:0:5829:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1787892845.793910:0:5829:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787892845.793926:0:5829:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1787892845.824893:0:5829:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787892845.825197:0:5829:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787892845.825204:0:5829:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787892845.826082:0:5829:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787892845.826090:0:5829:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787892845.827243:0:5829:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787892845.827252:0:5829:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1787892845.827722:0:5829:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1787892845.827742:0:5829:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1787892845.827748:0:5829:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.129@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1787892845.827930:0:5829:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.129@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787892845.827961:0:5829:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.129@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1787892845.827965:0:5829:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787892845.827966:0:5829:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787892845.827967:0:5829:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787892845.827968:0:5829:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787892845.827969:0:5829:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787892845.827970:0:5829:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787892845.827971:0:5829:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787892845.827972:0:5829:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787892845.827973:0:5829:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787892845.827974:0:5829:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787892845.827975:0:5829:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787892845.827976:0:5829:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787892845.827978:0:5829:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1787892845.827979:0:5829:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787892845.827980:0:5829:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787892845.827980:0:5829:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787892845.827981:0:5829:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787892845.827981:0:5829:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787892845.827982:0:5829:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787892845.827983:0:5829:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787892845.827996:0:5829:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787892845.827996:0:5829:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787892845.827997:0:5829:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787892845.827998:0:5829:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787892845.827998:0:5829:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787892845.828034:0:5829:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787892845.828050:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000103dc600 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:5829:1874741455487232:0@lo:253: 00000100:00100000:0.0:1787892845.828106:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892845.828147:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455487232 00000100:00100000:1.0:1787892845.828154:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455487232 00000100:00100000:0.0:1787892845.828155:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set 000000003ed374ab going to sleep for 11 seconds 00000100:00100000:1.0:1787892845.828207:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787892845.828216:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000fd325d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+5:5829:x1874741455487232:12345-0@lo:253: 20000000:01000000:1.0:1787892845.828371:0:5843:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787892845.828375:0:5843:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1787892845.829492:0:5863:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787892845.829536:0:5843:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1787892845.829927:0:5843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787892845.830699:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1787892845.831038:0:5843:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787892845.831043:0:5843:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1787892845.831050:0:5843:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1787892845.831053:0:5843:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1787892845.831065:0:5843:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1787892845.831362:0:5843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787892845.831527:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1787892845.831537:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787892845.831568:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1787892845.831609:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1787892845.831638:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1787892845.831746:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1787892845.831887:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1787892845.831940:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1787892845.831948:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1787892845.831971:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1787892845.831975:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1787892845.831994:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1787892845.832061:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1787892845.832085:0:5843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1787892845.832088:0:5843:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1787892845.832095:0:5843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787892845.832418:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1787892845.832429:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787892845.832462:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1787892845.832482:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1787892845.832510:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1787892845.832517:0:5843:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1787892845.832562:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1787892845.832567:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1787892845.832592:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1787892845.832612:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1787892845.832629:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1787892845.832635:0:5843:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1787892845.832830:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1787892845.832840:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1787892845.832866:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1787892845.832885:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1787892845.832977:0:5843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1787892845.833014:0:5843:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1787892845.833022:0:5843:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1787892845.833539:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1787892845.833916:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1787892845.833937:0:5843:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.129@tcp for mdt 20000000:01000000:1.0:1787892845.833938:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.129@tcp (null) (null) (null) 00000040:00080000:1.0:1787892845.833958:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1787892845.833962:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787892845.833996:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1787892845.834004:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.129@tcp (null) (null) 00000040:00080000:1.0:1787892845.834061:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1787892845.834069:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1787892845.834091:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1787892845.834109:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1787892845.834146:0:5843:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787892845.834149:0:5843:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787892845.834157:0:5843:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1787892845.834174:0:5843:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1787892845.834777:0:5866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:1.0:1787892845.834937:0:5843:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1787892845.848512:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1787892845.848578:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:1.0:1787892845.849435:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:1.0:1787892845.849464:0:5843:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787892845.849468:0:5843:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787892845.849472:0:5843:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787892845.849490:0:5843:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787892845.849494:0:5843:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787892845.849546:0:5843:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787892845.849548:0:5843:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787892845.851551:0:5867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1787892845.852568:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1787892845.852620:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1787892845.852650:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1787892845.853453:0:5843:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787892845.853456:0:5843:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787892845.854232:0:5868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:1.0:1787892845.854639:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:1.0:1787892845.854977:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:1.0:1787892845.855074:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:1.0:1787892845.855089:0:5843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787892845.855092:0:5843:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:1.0:1787892845.855099:0:5843:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787892845.855263:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000080926921/0x825e3f5022b4a3a4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892845.855287:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000080926921/0x825e3f5022b4a3a4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892845.855308:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000080926921/0x825e3f5022b4a3a4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892845.855332:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000080926921/0x825e3f5022b4a3a4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892845.855340:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000080926921/0x825e3f5022b4a3a4 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892845.855347:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000080926921/0x825e3f5022b4a3a4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892845.855353:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000080926921 already unused, calling callback (00000000ca5b779b) 00010000:00010000:1.0:1787892845.855358:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000080926921/0x825e3f5022b4a3a4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892845.855367:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000080926921/0x825e3f5022b4a3a4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892845.855382:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000080926921/0x825e3f5022b4a3a4 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892845.855390:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000080926921/0x825e3f5022b4a3a4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892845.855395:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000080926921/0x825e3f5022b4a3a4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787892845.855419:0:5843:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787892846.099711:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000fd325d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+5:5829:x1874741455487232:12345-0@lo:253: Request processed in 271487us (271593us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892846.099727:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787892846.100128:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000103dc600 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:5829:1874741455487232:0@lo:253: 10000000:01000000:1.0:1787892846.100153:0:5829:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787892846.100163:0:5829:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787892846.100166:0:5829:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787892846.100167:0:5829:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787892846.100168:0:5829:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1787892846.100170:0:5829:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787892846.100172:0:5829:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787892846.100173:0:5829:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787892846.100174:0:5829:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787892846.100176:0:5829:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787892846.100177:0:5829:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787892846.100179:0:5829:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787892846.100199:0:5829:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000094276459 from lustre-MDT0000 10000000:01000000:1.0:1787892846.100224:0:5829:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787892846.100227:0:5829:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787892846.100231:0:5829:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff907105a88000 10000000:01000000:1.0:1787892846.100235:0:5829:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787892846.100243:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff907105a88000 from 1 10000000:01000000:1.0:1787892846.100246:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787892846.100388:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: 0000000080926921/0x825e3f5022b4a3ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892846.100399:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: 0000000080926921/0x825e3f5022b4a3ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892846.100408:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: 0000000080926921/0x825e3f5022b4a3ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892846.100428:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000aabe3657 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:5829:1874741455487360:0@lo:101: 00000100:00100000:1.0:1787892846.100468:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892846.100525:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set 00000000807dda2c going to sleep for 11 seconds 00000100:00100000:2.0:1787892846.100590:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455487360 00000100:00100000:2.0:1787892846.100597:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455487360 00000100:00100000:2.0:1787892846.100642:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787892846.100659:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007793b6ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+5:5829:x1874741455487360:12345-0@lo:101: 00010000:00010000:2.0:1787892846.100673:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787892846.100689:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a5308fd1/0x825e3f5022b4a3b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4a3ab expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892846.100716:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a5308fd1/0x825e3f5022b4a3b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4a3ab expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892846.100724:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a5308fd1/0x825e3f5022b4a3b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a3ab expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892846.100734:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a5308fd1, rc 0) 00000100:00100000:2.0:1787892846.100807:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007793b6ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+6:5829:x1874741455487360:12345-0@lo:101: Request processed in 158us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892846.100813:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787892846.100980:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000aabe3657 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:5829:1874741455487360:0@lo:101: 00010000:00010000:1.0:1787892846.101068:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: 0000000080926921/0x825e3f5022b4a3ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a3b2 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892846.101077:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: 0000000080926921/0x825e3f5022b4a3ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a3b2 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892846.101191:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000aabe3657 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:5829:1874741455487488:0@lo:501: 00000100:00100000:1.0:1787892846.101219:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892846.101246:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set 00000000807dda2c going to sleep for 11 seconds 00000100:00100000:2.0:1787892846.101359:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455487488 00000100:00100000:2.0:1787892846.101364:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455487488 00000100:00100000:2.0:1787892846.101437:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787892846.101444:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008c51ed64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+6:5829:x1874741455487488:12345-0@lo:501: 00000100:00100000:2.0:1787892846.101703:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008c51ed64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+6:5829:x1874741455487488:12345-0@lo:501: Request processed in 259us (483us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787892846.101710:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787892846.101895:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000aabe3657 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:5829:1874741455487488:0@lo:501: 10000000:01000000:3.0:1787892846.101921:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787892846.101937:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: 0000000080926921/0x825e3f5022b4a3ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a3b2 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892846.101946:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: 0000000080926921/0x825e3f5022b4a3ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a3b2 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787892846.101955:0:5829:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90710510c800 10000000:01000000:3.0:1787892846.101959:0:5829:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787892846.101969:0:5829:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff90710510c800 10000000:01000000:3.0:1787892846.101972:0:5829:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787892846.101974:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff90710510c800 from 1 10000000:01000000:3.0:1787892846.101977:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787892846.102021:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: 0000000052cf200b/0x825e3f5022b4a3b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892846.102028:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: 0000000052cf200b/0x825e3f5022b4a3b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892846.102035:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: 0000000052cf200b/0x825e3f5022b4a3b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892846.102049:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e72a030f pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:5829:1874741455487616:0@lo:101: 00000100:00100000:3.0:1787892846.102076:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892846.102460:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set 000000003ce950cd going to sleep for 11 seconds 00000100:00100000:1.0:1787892846.102527:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455487616 00000100:00100000:1.0:1787892846.102533:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455487616 00000100:00100000:1.0:1787892846.102562:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787892846.102569:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000004a38b16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+6:5829:x1874741455487616:12345-0@lo:101: 00010000:00010000:1.0:1787892846.102579:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787892846.102592:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000793e1aa8/0x825e3f5022b4a3c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4a3b9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892846.102609:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000793e1aa8/0x825e3f5022b4a3c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4a3b9 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892846.102617:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000793e1aa8/0x825e3f5022b4a3c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a3b9 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892846.102626:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000793e1aa8, rc 0) 00000100:00100000:1.0:1787892846.102819:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000004a38b16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+7:5829:x1874741455487616:12345-0@lo:101: Request processed in 250us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892846.102826:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787892846.102899:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e72a030f pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:5829:1874741455487616:0@lo:101: 00010000:00010000:3.0:1787892846.102919:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: 0000000052cf200b/0x825e3f5022b4a3b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a3c0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892846.102928:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: 0000000052cf200b/0x825e3f5022b4a3b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a3c0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787892846.102940:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787892846.103049:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: 0000000052cf200b/0x825e3f5022b4a3b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a3c0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892846.103056:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: 0000000052cf200b/0x825e3f5022b4a3b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a3c0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787892846.103075:0:5829:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787892846.103078:0:5829:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787892846.103083:0:5829:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff90710510c800 10000000:01000000:3.0:1787892846.103086:0:5829:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787892846.103089:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787892846.103090:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787892846.103108:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: 00000000ce2922a3/0x825e3f5022b4a3c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892846.103113:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: 00000000ce2922a3/0x825e3f5022b4a3c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892846.103193:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: 00000000ce2922a3/0x825e3f5022b4a3c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892846.103209:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e72a030f pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:5829:1874741455487744:0@lo:101: 00000100:00100000:3.0:1787892846.103239:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892846.103337:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455487744 00000100:00100000:2.0:1787892846.103342:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455487744 00000100:00100000:2.0:1787892846.103372:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787892846.103385:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d01aa668 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+7:5829:x1874741455487744:12345-0@lo:101: 00010000:00010000:2.0:1787892846.103394:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787892846.103402:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000dfbbea87/0x825e3f5022b4a3ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4a3c7 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892846.103416:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dfbbea87/0x825e3f5022b4a3ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4a3c7 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892846.103423:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000dfbbea87/0x825e3f5022b4a3ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a3c7 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892846.103429:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000dfbbea87, rc 0) 00000100:00100000:2.0:1787892846.103455:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d01aa668 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+8:5829:x1874741455487744:12345-0@lo:101: Request processed in 71us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892846.103461:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787892846.103525:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set 000000003ce950cd going to sleep for 11 seconds 00000100:00100000:3.0:1787892846.103537:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e72a030f pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:5829:1874741455487744:0@lo:101: 00010000:00010000:3.0:1787892846.103549:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: 00000000ce2922a3/0x825e3f5022b4a3c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a3ce expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892846.103554:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: 00000000ce2922a3/0x825e3f5022b4a3c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a3ce expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892846.103599:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e72a030f pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:5829:1874741455487872:0@lo:501: 00000100:00100000:3.0:1787892846.103622:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892846.103648:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set 000000003ce950cd going to sleep for 11 seconds 00000100:00100000:0.0:1787892846.103784:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455487872 00000100:00100000:0.0:1787892846.103789:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455487872 00000100:00100000:0.0:1787892846.103811:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787892846.103816:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001da8c2b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+8:5829:x1874741455487872:12345-0@lo:501: 00000100:00100000:0.0:1787892846.104200:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001da8c2b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+9:5829:x1874741455487872:12345-0@lo:501: Request processed in 305us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892846.104208:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787892846.104391:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e72a030f pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:5829:1874741455487872:0@lo:501: 00000100:00100000:3.0:1787892846.104423:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e72a030f pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:5829:1874741455488000:0@lo:503: 00000100:00100000:3.0:1787892846.104464:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892846.104494:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set 000000003ce950cd going to sleep for 11 seconds 00000100:00100000:0.0:1787892846.104546:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455488000 00000100:00100000:0.0:1787892846.104551:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455488000 00000100:00100000:0.0:1787892846.104581:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787892846.104587:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000052d1f185 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+9:5829:x1874741455488000:12345-0@lo:503: 00000100:00100000:0.0:1787892846.104844:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000052d1f185 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+9:5829:x1874741455488000:12345-0@lo:503: Request processed in 257us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892846.104851:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787892846.104932:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e72a030f pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:5829:1874741455488000:0@lo:503: 00000100:00100000:2.0:1787892846.105649:0:5871:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d2c0f17f pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:5871:1874741455488128:0@lo:502: 00000100:00100000:3.0:1787892846.105922:0:5871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892846.106000:0:5871:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f760445e going to sleep for 11 seconds 00000100:00100000:0.0:1787892846.106091:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455488128 00000100:00100000:0.0:1787892846.106097:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455488128 00000100:00100000:0.0:1787892846.106238:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787892846.106247:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aff95f65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+9:5871:x1874741455488128:12345-0@lo:502: 00000100:00100000:0.0:1787892846.106465:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aff95f65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+9:5871:x1874741455488128:12345-0@lo:502: Request processed in 219us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892846.106485:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787892846.106565:0:5871:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d2c0f17f pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:5871:1874741455488128:0@lo:502: 00000020:01000000:3.0:1787892846.106595:0:5871:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787892846.106607:0:5871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787892846.106610:0:5871:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787892846.106614:0:5871:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1787892846.106617:0:5871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787892846.106636:0:5871:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000008dddab20) 00000020:00000080:3.0:1787892846.106818:0:5871:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1787892846.106828:0:5871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787892846.106919:0:5871:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787892846.106927:0:5871:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x825e3f5022b4a3dc 00000020:00000080:3.0:1787892846.107270:0:5871:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787892846.107278:0:5871:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787892846.107282:0:5871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787892846.107283:0:5871:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787892846.107286:0:5871:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787892846.107290:0:5871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787892846.107291:0:5871:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1787892846.107294:0:5871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787892846.107301:0:5871:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000c7d438d9) 00000020:00000080:3.0:1787892846.107312:0:5871:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1787892846.107316:0:5871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787892846.107325:0:5871:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1787892846.107328:0:5871:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1787892846.107334:0:5871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787892846.107379:0:5871:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000094276459 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787892846.107392:0:5871:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000076ff0feb) 00000020:00000080:3.0:1787892846.107399:0:5871:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1787892846.107459:0:5871:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787892846.107465:0:5871:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x825e3f5022b4a3f1 00000020:00000080:3.0:1787892846.107571:0:5871:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787892846.107578:0:5871:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787892846.107583:0:5871:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x825e3f5022b4a3f8 00080000:01000000:3.0:1787892846.107589:0:5871:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787892846.107592:0:5871:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x825e3f5022b4a3ff 00080000:10000000:3.0:1787892846.108397:0:5871:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1787892846.108587:0:5871:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1787892846.115405:0:5871:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:0.0:1787892846.199914:0:5871:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1787892846.200278:0:5871:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1787892846.205626:0:5871:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1787892846.206015:0:5871:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1787892846.250359:0:5871:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000f8b351eb) 00000020:00000080:1.0:1787892846.250385:0:5871:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1787892846.250467:0:5871:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787892846.250476:0:5871:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x825e3f5022b4a40d 00000020:00000080:1.0:1787892846.252888:0:5871:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1787892846.255466:0:5871:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787892846.298075:0:5871:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787892846.320265:0:5871:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787892846.358732:0:5871:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787892846.406930:0:5871:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787892846.439822:0:5871:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1787892846.476226:0:5871:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x825e3f5022b4a414 00000020:00000080:1.0:1787892846.476727:0:5871:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787892846.476745:0:5871:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787892846.476772:0:5871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787892846.476775:0:5871:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787892846.476779:0:5871:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787892846.476785:0:5871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787892846.476786:0:5871:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787892846.476790:0:5871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787892846.476828:0:5871:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787892846.476843:0:5871:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787892846.476846:0:5871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787892846.476847:0:5871:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1787892846.476849:0:5871:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787892846.476851:0:5871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787892846.476852:0:5871:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787892846.476855:0:5871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787892846.476856:0:5871:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787892846.476900:0:5871:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c5838ad2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:5871:1874741455488256:0@lo:502: 00000100:00100000:1.0:1787892846.476987:0:5871:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892846.477052:0:5871:0:(client.c:2715:ptlrpc_set_wait()) set 000000000b9c4ac4 going to sleep for 11 seconds 00000100:00100000:2.0:1787892846.477122:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455488256 00000100:00100000:2.0:1787892846.477130:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455488256 00000100:00100000:2.0:1787892846.477188:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787892846.477196:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000837b09b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+9:5871:x1874741455488256:12345-0@lo:502: 00000100:00100000:2.0:1787892846.477499:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000837b09b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+9:5871:x1874741455488256:12345-0@lo:502: Request processed in 304us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892846.477507:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787892846.477732:0:5871:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c5838ad2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:5871:1874741455488256:0@lo:502: 00000020:01000000:1.0:1787892846.477790:0:5871:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787892846.477796:0:5871:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787892846.477797:0:5871:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787892846.477801:0:5871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1787892846.477953:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1787892846.477973:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787892846.477991:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: 00000000ce2922a3/0x825e3f5022b4a3c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a3ce expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892846.478011:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: 00000000ce2922a3/0x825e3f5022b4a3c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a3ce expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892846.478019:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90710510c800 from 1 10000000:01000000:2.0:1787892846.478023:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787892846.478049:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: 000000009a74cc81/0x825e3f5022b4a41b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892846.478055:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: 000000009a74cc81/0x825e3f5022b4a41b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892846.478063:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: 000000009a74cc81/0x825e3f5022b4a41b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892846.478076:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007168b70e pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:5829:1874741455488384:0@lo:101: 00000100:00100000:2.0:1787892846.478106:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892846.478125:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set 000000008397071f going to sleep for 11 seconds 00000100:00100000:0.0:1787892846.478200:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455488384 00000100:00100000:0.0:1787892846.478205:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455488384 00000100:00100000:0.0:1787892846.478238:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787892846.478245:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000554a007 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+9:5829:x1874741455488384:12345-0@lo:101: 00010000:00010000:0.0:1787892846.478309:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787892846.478323:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007fa541be/0x825e3f5022b4a422 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4a41b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892846.478342:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007fa541be/0x825e3f5022b4a422 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4a41b expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892846.478352:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007fa541be/0x825e3f5022b4a422 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a41b expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892846.478360:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007fa541be, rc 0) 00000100:00100000:0.0:1787892846.478390:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000554a007 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+10:5829:x1874741455488384:12345-0@lo:101: Request processed in 145us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892846.478396:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787892846.478473:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007168b70e pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:5829:1874741455488384:0@lo:101: 00010000:00010000:2.0:1787892846.478484:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: 000000009a74cc81/0x825e3f5022b4a41b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a422 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892846.478492:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: 000000009a74cc81/0x825e3f5022b4a41b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a422 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892846.479143:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007168b70e pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:5829:1874741455488512:0@lo:256: 00000100:00100000:2.0:1787892846.479195:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892846.479220:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set 000000008397071f going to sleep for 11 seconds 00000100:00100000:0.0:1787892846.479494:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455488512 00000100:00100000:0.0:1787892846.479501:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455488512 00000100:00100000:0.0:1787892846.479540:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787892846.479553:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003afc1672 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+10:5829:x1874741455488512:12345-0@lo:256: 20000000:01000000:0.0:1787892846.479569:0:5843:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787892846.479574:0:5843:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787892846.479638:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003afc1672 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+10:5829:x1874741455488512:12345-0@lo:256: Request processed in 87us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892846.479645:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787892846.479873:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007168b70e pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:5829:1874741455488512:0@lo:256: 10000000:01000000:0.0:1787892846.480924:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787892846.480979:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: 000000009a74cc81/0x825e3f5022b4a41b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a422 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892846.480990:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: 000000009a74cc81/0x825e3f5022b4a41b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a422 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787892846.480999:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90710510c800 from 1 10000000:01000000:0.0:1787892846.481002:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787892846.481038:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: 000000002e8c9bb6/0x825e3f5022b4a429 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892846.481045:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: 000000002e8c9bb6/0x825e3f5022b4a429 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892846.481053:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: 000000002e8c9bb6/0x825e3f5022b4a429 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892846.481069:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d3d35370 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:5829:1874741455488640:0@lo:101: 00000100:00100000:0.0:1787892846.481114:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892846.481169:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set 0000000005322c82 going to sleep for 11 seconds 00000100:00100000:2.0:1787892846.481344:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455488640 00000100:00100000:2.0:1787892846.481350:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455488640 00000100:00100000:2.0:1787892846.481396:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787892846.481403:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000021e7050f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+10:5829:x1874741455488640:12345-0@lo:101: 00010000:00010000:2.0:1787892846.481414:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787892846.481427:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008e94061f/0x825e3f5022b4a430 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4a429 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892846.481448:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008e94061f/0x825e3f5022b4a430 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4a429 expref: 11 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892846.481456:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008e94061f/0x825e3f5022b4a430 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a429 expref: 11 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892846.481464:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008e94061f, rc 0) 00000100:00100000:2.0:1787892846.481508:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000021e7050f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+11:5829:x1874741455488640:12345-0@lo:101: Request processed in 106us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892846.481513:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787892846.481637:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d3d35370 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:5829:1874741455488640:0@lo:101: 00010000:00010000:3.0:1787892846.481720:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: 000000002e8c9bb6/0x825e3f5022b4a429 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a430 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892846.481729:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: 000000002e8c9bb6/0x825e3f5022b4a429 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a430 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892846.481809:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e72a030f pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:5829:1874741455488768:0@lo:501: 00000100:00100000:3.0:1787892846.481838:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892846.481857:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set 000000009d670f73 going to sleep for 11 seconds 00000100:00100000:2.0:1787892846.481910:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455488768 00000100:00100000:2.0:1787892846.481914:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455488768 00000100:00100000:2.0:1787892846.481980:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787892846.481987:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000feff5968 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+11:5829:x1874741455488768:12345-0@lo:501: 00000100:00100000:2.0:1787892846.482644:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000feff5968 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+11:5829:x1874741455488768:12345-0@lo:501: Request processed in 657us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892846.482809:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787892846.482948:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e72a030f pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:5829:1874741455488768:0@lo:501: 00000100:00100000:3.0:1787892846.482981:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e72a030f pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:5829:1874741455488896:0@lo:503: 00000100:00100000:3.0:1787892846.483030:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892846.483131:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set 000000009d670f73 going to sleep for 11 seconds 00000100:00100000:0.0:1787892846.483199:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455488896 00000100:00100000:0.0:1787892846.483211:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455488896 00000100:00100000:0.0:1787892846.483241:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787892846.483247:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000008d62895 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+11:5829:x1874741455488896:12345-0@lo:503: 00000040:00080000:0.0:1787892846.483395:0:5843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787892846.483445:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000008d62895 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+11:5829:x1874741455488896:12345-0@lo:503: Request processed in 197us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892846.483450:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787892846.483531:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e72a030f pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:5829:1874741455488896:0@lo:503: 00000040:00080000:3.0:1787892846.484568:0:5875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1787892846.484847:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1787892846.484868:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787892846.484891:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: 000000002e8c9bb6/0x825e3f5022b4a429 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a430 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892846.484902:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: 000000002e8c9bb6/0x825e3f5022b4a429 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a430 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787892846.484947:0:5829:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787892846.484950:0:5829:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90710510c800 10000000:01000000:0.0:1787892846.484953:0:5829:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90710510c800 10000000:01000000:0.0:1787892846.484957:0:5829:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787892846.484963:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90710510c800 from 1 10000000:01000000:0.0:1787892846.484966:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787892846.485005:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: 00000000321a5af0/0x825e3f5022b4a437 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892846.485012:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: 00000000321a5af0/0x825e3f5022b4a437 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892846.485025:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: 00000000321a5af0/0x825e3f5022b4a437 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892846.485045:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000909ac8f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:5829:1874741455489024:0@lo:101: 00000100:00100000:0.0:1787892846.485115:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892846.485231:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set 0000000091823d29 going to sleep for 11 seconds 00000100:00100000:0.0:1787892846.485320:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455489024 00000100:00100000:0.0:1787892846.485327:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455489024 00000100:00100000:0.0:1787892846.485360:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787892846.485368:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009fae4d87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+11:5829:x1874741455489024:12345-0@lo:101: 00010000:00010000:0.0:1787892846.485380:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787892846.485391:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ece81baa/0x825e3f5022b4a43e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4a437 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892846.485416:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ece81baa/0x825e3f5022b4a43e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4a437 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892846.485425:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ece81baa/0x825e3f5022b4a43e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a437 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892846.485434:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ece81baa, rc 0) 00000100:00100000:0.0:1787892846.485470:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009fae4d87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+12:5829:x1874741455489024:12345-0@lo:101: Request processed in 103us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892846.485477:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787892846.485517:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000909ac8f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:5829:1874741455489024:0@lo:101: 00010000:00010000:0.0:1787892846.485532:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: 00000000321a5af0/0x825e3f5022b4a437 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a43e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892846.485540:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: 00000000321a5af0/0x825e3f5022b4a437 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a43e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892846.485585:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000909ac8f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:5829:1874741455489152:0@lo:501: 00000100:00100000:0.0:1787892846.485618:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892846.485631:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set 0000000091823d29 going to sleep for 11 seconds 00000100:00100000:0.0:1787892846.485643:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455489152 00000100:00100000:0.0:1787892846.485818:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455489152 00000100:00100000:0.0:1787892846.485839:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787892846.485844:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000950b5a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+12:5829:x1874741455489152:12345-0@lo:501: 00000100:00100000:0.0:1787892846.486218:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000950b5a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+12:5829:x1874741455489152:12345-0@lo:501: Request processed in 372us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892846.486225:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787892846.486543:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000909ac8f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:5829:1874741455489152:0@lo:501: 00000100:00100000:3.0:1787892846.486580:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e72a030f pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:5829:1874741455489280:0@lo:503: 00000100:00100000:3.0:1787892846.486621:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892846.486973:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set 000000005c3beb50 going to sleep for 11 seconds 00000100:00100000:0.0:1787892846.487018:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455489280 00000100:00100000:0.0:1787892846.487025:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455489280 00000100:00100000:0.0:1787892846.487090:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787892846.487098:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000774ca098 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+12:5829:x1874741455489280:12345-0@lo:503: 00000100:00100000:0.0:1787892846.487512:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000774ca098 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+12:5829:x1874741455489280:12345-0@lo:503: Request processed in 415us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892846.487520:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787892846.487589:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e72a030f pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:5829:1874741455489280:0@lo:503: 00000100:00100000:3.0:1787892846.488021:0:5876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e72a030f pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:5876:1874741455489408:0@lo:502: 00000100:00100000:3.0:1787892846.488060:0:5876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892846.488245:0:5876:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b548ccf8 going to sleep for 11 seconds 00000100:00100000:2.0:1787892846.488357:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455489408 00000100:00100000:2.0:1787892846.488363:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455489408 00000100:00100000:2.0:1787892846.488391:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787892846.488406:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004a1164dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+12:5876:x1874741455489408:12345-0@lo:502: 00000100:00100000:2.0:1787892846.488628:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004a1164dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+12:5876:x1874741455489408:12345-0@lo:502: Request processed in 224us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892846.488635:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787892846.488797:0:5876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e72a030f pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:5876:1874741455489408:0@lo:502: 00000020:01000004:3.0:1787892846.488848:0:5876:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787892846.488863:0:5876:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000d2811f84) 00000020:00000080:3.0:1787892846.488882:0:5876:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1787892846.488957:0:5876:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000094276459 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787892846.488961:0:5876:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000094276459 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787892846.488963:0:5876:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000094276459 4 00010000:00080000:3.0:1787892846.488999:0:5876:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b2a17a49@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.129@tcp at head 00010000:00010000:3.0:1787892846.491443:0:5876:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1787892846.491737:0:5876:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787892846.491795:0:5876:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787892846.491807:0:5876:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x825e3f5022b4a44c 00000100:00080000:3.0:1787892846.491815:0:5876:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787892846.491819:0:5876:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000b2a17a49 using connection 192.168.202.129@tcp/0@lo 00000100:00100000:3.0:1787892846.491849:0:5876:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e72a030f x1874741455489536/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787892846.491885:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e72a030f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874741455489536:0@lo:38: 00000100:00100000:3.0:1787892846.491942:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787892846.491987:0:5876:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787892846.492062:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455489536 00000100:00100000:2.0:1787892846.492070:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455489536 00000100:00100000:2.0:1787892846.492107:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787892846.492113:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000029150e6a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1874741455489536:12345-0@lo:38: 00000100:00100000:2.0:1787892846.492178:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000029150e6a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1874741455489536:12345-0@lo:38: Request processed in 65us (236us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787892846.492185:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787892846.492220:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787892846.492226:0:3304:0:(import.c:65:import_set_state_nolock()) 00000000b2a17a49 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787892846.492230:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787892846.492233:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e72a030f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874741455489536:0@lo:38: 00000100:00100000:3.0:1787892846.492978:0:5876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ca7fde91 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:5876:1874741455489664:0@lo:502: 00000100:00100000:3.0:1787892846.493028:0:5876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892846.493059:0:5876:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a986c73b going to sleep for 11 seconds 00000100:00100000:1.0:1787892846.493102:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455489664 00000100:00100000:1.0:1787892846.493107:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455489664 00000100:00100000:1.0:1787892846.493164:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787892846.493171:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007bd5ef30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+12:5876:x1874741455489664:12345-0@lo:502: 00000100:00100000:1.0:1787892846.493391:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007bd5ef30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+12:5876:x1874741455489664:12345-0@lo:502: Request processed in 221us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892846.493399:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787892846.493444:0:5876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ca7fde91 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:5876:1874741455489664:0@lo:502: 00000040:00080000:1.0:1787892846.493468:0:5876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1787892846.493515:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1787892846.493543:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787892846.493556:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: 00000000321a5af0/0x825e3f5022b4a437 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a43e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892846.493565:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: 00000000321a5af0/0x825e3f5022b4a437 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a43e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787892846.493606:0:5829:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787892846.493608:0:5829:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787892846.493610:0:5829:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787892846.493611:0:5829:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787892846.493612:0:5829:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787892846.493613:0:5829:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787892846.493614:0:5829:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787892846.493616:0:5829:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787892846.493617:0:5829:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787892846.493618:0:5829:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787892846.493620:0:5829:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787892846.493621:0:5829:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787892846.493624:0:5829:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1787892846.493627:0:5829:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787892846.493628:0:5829:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787892846.493633:0:5829:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787892846.493634:0:5829:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787892846.493635:0:5829:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787892846.493636:0:5829:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787892846.493637:0:5829:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787892846.493638:0:5829:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787892846.493638:0:5829:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787892846.493639:0:5829:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787892846.493640:0:5829:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787892846.493641:0:5829:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787892846.493922:0:5829:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787892846.493932:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c5838ad2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:5829:1874741455489792:0@lo:253: 00000100:00100000:1.0:1787892846.493964:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892846.494137:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d416264f going to sleep for 11 seconds 00000100:00100000:3.0:1787892846.496242:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455489792 00000100:00100000:3.0:1787892846.496316:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455489792 00000100:00100000:3.0:1787892846.496373:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787892846.496383:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c8d7fc3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+12:5829:x1874741455489792:12345-0@lo:253: 20000000:01000000:3.0:1787892846.496423:0:5841:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787892846.496438:0:5841:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787892846.526613:0:5841:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787892846.526635:0:5841:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787892846.528539:0:5863:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787892846.528549:0:5863:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787892846.528571:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000061a2157f/0x825e3f5022b4a453 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892846.528591:0:5863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007fa541be/0x825e3f5022b4a422 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a41b expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892846.528598:0:5863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000061a2157f/0x825e3f5022b4a453 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892846.528643:0:5863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007fa541be/0x825e3f5022b4a422 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x825e3f5022b4a41b expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892846.528671:0:5863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007fa541be/0x825e3f5022b4a422 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x825e3f5022b4a41b expref: 12 pid: 5841 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892846.528685:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008d899d06 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5863:1874741455489920:0@lo:104: 00000100:00100000:1.0:1787892846.528772:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892846.528823:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set 000000002215dab7 going to sleep for 11 seconds 00000100:00100000:3.0:1787892846.528955:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455489920 00000100:00100000:3.0:1787892846.528965:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455489920 00000100:00100000:3.0:1787892846.529015:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787892846.529025:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000319bd440 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22d910cf-711e-44e0-9acf-212404ada550+3:5863:x1874741455489920:12345-0@lo:104: 00010000:00010000:3.0:1787892846.529039:0:5831:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: 000000009a74cc81/0x825e3f5022b4a41b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a422 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892846.529089:0:5831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787892846.529094:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000319bd440 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22d910cf-711e-44e0-9acf-212404ada550+3:5863:x1874741455489920:12345-0@lo:104: Request processed in 71us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892846.529101:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787892846.529240:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787892846.529246:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: 000000009a74cc81/0x825e3f5022b4a41b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a422 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892846.529262:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009a74cc81 already unused, calling callback (000000007f06fe37) 10000000:00010000:1.0:1787892846.529265:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: 000000009a74cc81/0x825e3f5022b4a41b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x825e3f5022b4a422 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892846.529272:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: 000000009a74cc81/0x825e3f5022b4a41b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x825e3f5022b4a422 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787892846.529278:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: 000000009a74cc81/0x825e3f5022b4a41b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x825e3f5022b4a422 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787892846.529283:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787892846.529320:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: 000000009a74cc81/0x825e3f5022b4a41b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a422 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892846.529326:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787892846.529346:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: 000000009a74cc81/0x825e3f5022b4a41b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a422 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892846.529352:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: 000000009a74cc81/0x825e3f5022b4a41b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a422 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892846.529369:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892846.529371:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892846.529372:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787892846.529425:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000002b8241a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22d910cf-711e-44e0-9acf-212404ada550:3306:1874741455490048:0@lo:103: 00000100:00100000:1.0:1787892846.529456:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892846.529539:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455490048 00000100:00100000:1.0:1787892846.529548:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455490048 00010000:00010000:1.0:1787892846.529566:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007fa541be/0x825e3f5022b4a422 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a41b expref: 13 pid: 5841 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892846.529588:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787892846.529595:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003807a55d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22d910cf-711e-44e0-9acf-212404ada550+13:3306:x1874741455490048:12345-0@lo:103: 00010000:00010000:1.0:1787892846.529604:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787892846.529608:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007fa541be/0x825e3f5022b4a422 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a41b expref: 13 pid: 5841 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892846.529617:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007fa541be/0x825e3f5022b4a422 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x825e3f5022b4a41b expref: 13 pid: 5841 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892846.529633:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000061a2157f/0x825e3f5022b4a453 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892846.529639:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000061a2157f/0x825e3f5022b4a453 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787892846.529802:0:5833:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001254390s 00010000:00010000:1.0:1787892846.529807:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000061a2157f/0x825e3f5022b4a453 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892846.529814:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000061a2157f/0x825e3f5022b4a453 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892846.529819:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000061a2157f/0x825e3f5022b4a453 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892846.529824:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000061a2157f/0x825e3f5022b4a453 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892846.529838:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000061a2157f already unused, calling callback (00000000ca5b779b) 00010000:00010000:1.0:1787892846.529841:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000061a2157f/0x825e3f5022b4a453 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892846.529847:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000061a2157f/0x825e3f5022b4a453 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892846.529854:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000061a2157f/0x825e3f5022b4a453 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892846.529863:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787892846.529894:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003807a55d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22d910cf-711e-44e0-9acf-212404ada550+13:3306:x1874741455490048:12345-0@lo:103: Request processed in 300us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892846.529900:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787892846.529940:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000002b8241a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22d910cf-711e-44e0-9acf-212404ada550:3306:1874741455490048:0@lo:103: 00010000:00010000:1.0:1787892846.529966:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007fa541be/0x825e3f5022b4a422 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x825e3f5022b4a41b expref: 12 pid: 5841 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892846.529975:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008d899d06 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5863:1874741455489920:0@lo:104: 00010000:00010000:1.0:1787892846.529983:0:5863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000061a2157f/0x825e3f5022b4a453 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892846.529989:0:5863:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000061a2157f/0x825e3f5022b4a453 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892846.529993:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000061a2157f/0x825e3f5022b4a453 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892846.529997:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000061a2157f/0x825e3f5022b4a453 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892846.537812:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c8d7fc3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+11:5829:x1874741455489792:12345-0@lo:253: Request processed in 41422us (43839us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892846.537827:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787892846.540340:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c5838ad2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:5829:1874741455489792:0@lo:253: 10000000:01000000:2.0:1787892846.540363:0:5829:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787892846.540366:0:5829:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787892846.540368:0:5829:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787892846.540370:0:5829:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787892846.540371:0:5829:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787892846.540372:0:5829:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787892846.540373:0:5829:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787892846.540374:0:5829:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787892846.540376:0:5829:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787892846.540377:0:5829:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787892846.540378:0:5829:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787892846.540380:0:5829:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787892846.540381:0:5829:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787892846.540397:0:5829:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787892846.549902:0:5829:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1787892846.550515:0:5829:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787892846.550990:0:5829:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1787892846.551321:0:5829:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787892846.551543:0:5829:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1787892846.551866:0:5829:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1787892846.552798:0:5829:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1787892846.553003:0:5829:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1787892846.553441:0:5829:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1787892846.553628:0:5829:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1787892846.554114:0:5829:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1787892846.554468:0:5829:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1787892846.594927:0:5829:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1787892846.630141:0:5829:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1787892846.630510:0:5882:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787892846.634100:0:5829:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000020:00080000:0.0:1787892846.634346:0:5881:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1787892846.634351:0:5881:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:1.0:1787892846.634524:0:5829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787892846.635042:0:5829:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787892846.635051:0:5829:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787892846.635352:0:5829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787892846.636836:0:5829:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787892846.638550:0:5829:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787892846.638618:0:5829:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1787892846.648398:0:5829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1787892846.648618:0:5829:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1787892846.654582:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1787892846.655884:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1787892846.656083:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1787892846.656266:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1787892846.656408:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1787892846.656579:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1787892846.656995:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1787892846.657238:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1787892846.657382:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1787892846.657566:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1787892846.658036:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1787892846.658296:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1787892846.658440:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1787892846.658604:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1787892846.659084:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1787892846.659270:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1787892846.659569:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1787892846.660058:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1787892846.660242:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1787892846.660406:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1787892846.660552:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1787892846.660847:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1787892846.660998:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1787892846.661260:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1787892846.661397:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1787892846.661539:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1787892846.661898:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1787892846.662069:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1787892846.662353:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1787892846.662512:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1787892846.662722:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1787892846.662911:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1787892846.663111:0:5829:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:1.0:1787892846.666040:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787892846.679797:0:5882:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1787892846.732724:0:5829:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787892846.732785:0:5829:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa30dc1cab988 00100000:10000000:1.0:1787892846.732797:0:5829:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787892846.733585:0:5829:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787892846.733603:0:5829:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.129@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787892846.733615:0:5829:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787892846.733644:0:5829:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:3.0:1787892846.785645:0:5882:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787892846.785724:0:5882:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787892846.785729:0:5882:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1787892847.689085:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787892848.712978:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787892849.743080:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892850.767251:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787892851.401874:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787892851.401884:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90710510c800 from 3 10000000:01000000:1.0:1787892851.401890:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787892851.401943:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: 000000004609cec3/0x825e3f5022b4a45a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892851.401956:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: 000000004609cec3/0x825e3f5022b4a45a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892851.401969:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: 000000004609cec3/0x825e3f5022b4a45a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892851.401995:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008d899d06 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455490176:0@lo:101: 00000100:00100000:1.0:1787892851.402073:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892851.402197:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set 0000000040022f79 going to sleep for 11 seconds 00000100:00100000:3.0:1787892851.402276:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455490176 00000100:00100000:3.0:1787892851.402285:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455490176 00000100:00100000:3.0:1787892851.402345:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787892851.402356:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000af6dac71 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+11:5846:x1874741455490176:12345-0@lo:101: 00010000:00010000:3.0:1787892851.402371:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787892851.402385:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000de8b53ad/0x825e3f5022b4a461 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4a45a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892851.402413:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000de8b53ad/0x825e3f5022b4a461 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4a45a expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892851.402439:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000de8b53ad/0x825e3f5022b4a461 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a45a expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892851.402449:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000de8b53ad, rc 0) 00000100:00100000:3.0:1787892851.402592:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000af6dac71 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+12:5846:x1874741455490176:12345-0@lo:101: Request processed in 238us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892851.402600:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787892851.402835:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008d899d06 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455490176:0@lo:101: 00010000:00010000:0.0:1787892851.402854:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: 000000004609cec3/0x825e3f5022b4a45a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a461 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892851.402864:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: 000000004609cec3/0x825e3f5022b4a45a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a461 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892851.402940:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f567b716 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455490304:0@lo:256: 00000100:00100000:0.0:1787892851.402978:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892851.403000:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c6b32414 going to sleep for 11 seconds 00000100:00100000:1.0:1787892851.403055:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455490304 00000100:00100000:1.0:1787892851.403061:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455490304 00000100:00100000:1.0:1787892851.403096:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787892851.403103:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000157d3259 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+12:5846:x1874741455490304:12345-0@lo:256: 20000000:01000000:1.0:1787892851.403129:0:5841:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787892851.403146:0:5841:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787892851.403148:0:5841:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1787892851.403237:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000157d3259 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+12:5846:x1874741455490304:12345-0@lo:256: Request processed in 134us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892851.403245:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787892851.403327:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f567b716 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455490304:0@lo:256: 10000000:01000000:0.0:1787892851.403378:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787892851.403384:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: 000000004609cec3/0x825e3f5022b4a45a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a461 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892851.403392:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: 000000004609cec3/0x825e3f5022b4a45a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a461 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892851.795457:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787892851.818457:0:6125:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg229-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1787892851.913835:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787892851.913843:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787892851.913846:0:37:0:(import.c:65:import_set_state_nolock()) 00000000b2a17a49 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787892851.913857:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000b2a17a49 using connection 192.168.202.129@tcp/0@lo 00000100:00100000:3.0:1787892851.913890:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000bfd57d34 x1874741455490432/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787892851.914152:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bfd57d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874741455490432:0@lo:38: 00000100:00100000:0.0:1787892851.914225:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892851.914558:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455490432 00000100:00100000:3.0:1787892851.914566:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455490432 00000100:00100000:3.0:1787892851.914605:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787892851.914612:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f567b716 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1874741455490432:12345-0@lo:38: 00010000:00080000:3.0:1787892851.914637:0:5849:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 179 last 0 00000020:00000080:3.0:1787892851.915149:0:5849:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x825e3f5022b4a468 00000004:00100000:3.0:1787892851.915219:0:5849:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787892851.916444:0:5849:0:(import.c:65:import_set_state_nolock()) 00000000bf20c339 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787892851.917144:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f567b716 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874741455490432:12345-0@lo:38: Request processed in 2529us (2918us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892851.917156:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787892851.917249:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000bfd57d34 x1874741455490432/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787892861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787892851.917274:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787892851.917282:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787892851.917286:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787892851.917289:0:3304:0:(import.c:65:import_set_state_nolock()) 00000000b2a17a49 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787892851.917294:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bfd57d34 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874741455490432:0@lo:38: 00010000:00010000:3.0:1787892852.811909:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787892853.833124:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787892854.856948:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787892855.885148:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787892856.904900:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787892857.041502:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000851cd6be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22d910cf-711e-44e0-9acf-212404ada550:3307:1874741455490560:0@lo:400: 00000100:00100000:0.0:1787892857.041587:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892857.041642:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787892857.041648:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fc0fe827 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874741455490688:0@lo:400: 00000100:00100000:0.0:1787892857.041673:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892857.041897:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455490688 00000100:00100000:3.0:1787892857.041907:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455490688 00000100:00100000:3.0:1787892857.041959:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787892857.041970:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005475a27d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874741455490688:12345-0@lo:400: 00000100:00100000:3.0:1787892857.042109:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005475a27d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874741455490688:12345-0@lo:400: Request processed in 140us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892857.042116:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787892857.042279:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000fc0fe827 x1874741455490688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892857.042294:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fc0fe827 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874741455490688:0@lo:400: 00000100:00100000:2.0:1787892857.042435:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455490560 00000100:00100000:2.0:1787892857.042452:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455490560 00000100:00100000:2.0:1787892857.042491:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787892857.042498:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009a72da99 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+12:3307:x1874741455490560:12345-0@lo:400: 00000100:00100000:2.0:1787892857.042534:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009a72da99 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+12:3307:x1874741455490560:12345-0@lo:400: Request processed in 38us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892857.042540:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787892857.043694:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000851cd6be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22d910cf-711e-44e0-9acf-212404ada550:3307:1874741455490560:0@lo:400: 00000020:00000080:2.0:1787892857.279571:0:6326:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffffdd107b0 20000000:00000080:2.0:1787892857.279593:0:6326:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90711b99bc00 uarg=0000000000000000 20000000:01000000:2.0:1787892857.279630:0:6326:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787892857.279637:0:6326:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787892857.279643:0:6326:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787892857.279941:0:6326:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1787892857.279954:0:6326:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1787892857.287479:0:6326:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787892857.288121:0:6326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787892857.288192:0:6326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1787892857.288250:0:6326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1787892857.288269:0:6326:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787892857.288289:0:6326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f47987f9/0x825e3f5022b4a46f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892857.288309:0:6326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008e94061f/0x825e3f5022b4a430 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a429 expref: 11 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892857.288315:0:6326:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000f47987f9/0x825e3f5022b4a46f lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892857.288389:0:6326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008e94061f/0x825e3f5022b4a430 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x825e3f5022b4a429 expref: 11 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892857.288403:0:6326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008e94061f/0x825e3f5022b4a430 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x825e3f5022b4a429 expref: 11 pid: 5843 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892857.288427:0:6326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008ba9ab09 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6326:1874741455490816:0@lo:104: 00000100:00100000:2.0:1787892857.288488:0:6326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892857.288906:0:6326:0:(client.c:2715:ptlrpc_set_wait()) set 0000000095144a07 going to sleep for 11 seconds 00000100:00100000:1.0:1787892857.289014:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455490816 00000100:00100000:1.0:1787892857.289023:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455490816 00000100:00100000:1.0:1787892857.289080:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787892857.289089:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004949f53e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22d910cf-711e-44e0-9acf-212404ada550+3:6326:x1874741455490816:12345-0@lo:104: 00010000:00010000:1.0:1787892857.289102:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: 000000002e8c9bb6/0x825e3f5022b4a429 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a430 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892857.289179:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787892857.289185:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004949f53e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22d910cf-711e-44e0-9acf-212404ada550+3:6326:x1874741455490816:12345-0@lo:104: Request processed in 98us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892857.289192:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1787892857.289207:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787892857.289272:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: 000000002e8c9bb6/0x825e3f5022b4a429 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a430 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892857.289281:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002e8c9bb6 already unused, calling callback (000000007f06fe37) 10000000:00010000:0.0:1787892857.289290:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: 000000002e8c9bb6/0x825e3f5022b4a429 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x825e3f5022b4a430 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892857.289298:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: 000000002e8c9bb6/0x825e3f5022b4a429 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x825e3f5022b4a430 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787892857.289304:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: 000000002e8c9bb6/0x825e3f5022b4a429 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x825e3f5022b4a430 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787892857.289309:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787892857.289346:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: 000000002e8c9bb6/0x825e3f5022b4a429 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a430 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892857.289352:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787892857.289366:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: 000000002e8c9bb6/0x825e3f5022b4a429 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a430 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892857.289372:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: 000000002e8c9bb6/0x825e3f5022b4a429 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a430 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892857.289388:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787892857.289390:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787892857.289391:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787892857.289401:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d1051f10 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455490944:0@lo:103: 00000100:00100000:1.0:1787892857.289432:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892857.289442:0:6326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008ba9ab09 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6326:1874741455490816:0@lo:104: 00010000:00010000:2.0:1787892857.289458:0:6326:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000f47987f9/0x825e3f5022b4a46f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892857.289506:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455490944 00000100:00100000:0.0:1787892857.289511:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455490944 00010000:00010000:0.0:1787892857.289530:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008e94061f/0x825e3f5022b4a430 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a429 expref: 12 pid: 5843 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892857.289683:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787892857.289690:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000002b8241a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22d910cf-711e-44e0-9acf-212404ada550+12:3305:x1874741455490944:12345-0@lo:103: 00010000:00010000:0.0:1787892857.289701:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787892857.289711:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008e94061f/0x825e3f5022b4a430 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a429 expref: 12 pid: 5843 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892857.289720:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008e94061f/0x825e3f5022b4a430 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x825e3f5022b4a429 expref: 12 pid: 5843 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892857.289732:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008e94061f/0x825e3f5022b4a430 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x825e3f5022b4a429 expref: 12 pid: 5843 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892857.289743:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000f47987f9/0x825e3f5022b4a46f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892857.289749:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f47987f9/0x825e3f5022b4a46f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892857.289866:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f47987f9/0x825e3f5022b4a46f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892857.289872:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f47987f9/0x825e3f5022b4a46f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892857.289877:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f47987f9/0x825e3f5022b4a46f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892857.289883:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f47987f9/0x825e3f5022b4a46f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892857.289887:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f47987f9 already unused, calling callback (00000000ca5b779b) 00010000:00010000:0.0:1787892857.289891:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f47987f9/0x825e3f5022b4a46f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892857.289897:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f47987f9/0x825e3f5022b4a46f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892857.290301:0:6326:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000f47987f9/0x825e3f5022b4a46f lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892857.290309:0:6326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f47987f9/0x825e3f5022b4a46f lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892857.292266:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f47987f9/0x825e3f5022b4a46f lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892857.292286:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f47987f9/0x825e3f5022b4a46f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892857.292307:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787892857.292434:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000002b8241a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22d910cf-711e-44e0-9acf-212404ada550+11:3305:x1874741455490944:12345-0@lo:103: Request processed in 2742us (2999us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892857.292444:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787892857.295388:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d1051f10 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455490944:0@lo:103: 00010000:00010000:0.0:1787892857.930617:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787892858.959588:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892859.979918:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787892861.002253:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787892861.326101:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787892861.326109:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90710510c800 from 1 10000000:01000000:3.0:1787892861.326115:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787892861.326161:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: 00000000fd4a15ef/0x825e3f5022b4a476 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892861.326186:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: 00000000fd4a15ef/0x825e3f5022b4a476 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892861.326199:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: 00000000fd4a15ef/0x825e3f5022b4a476 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892861.326223:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bfd57d34 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455491072:0@lo:101: 00000100:00100000:3.0:1787892861.326291:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892861.326339:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f2ae5aa0 going to sleep for 11 seconds 00000100:00100000:3.0:1787892861.326364:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455491072 00000100:00100000:3.0:1787892861.326373:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455491072 00000100:00100000:3.0:1787892861.326434:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787892861.326442:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000db9fb47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+11:5846:x1874741455491072:12345-0@lo:101: 00010000:00010000:3.0:1787892861.326457:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787892861.326470:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000662e02ea/0x825e3f5022b4a47d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4a476 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892861.326492:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000662e02ea/0x825e3f5022b4a47d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4a476 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892861.326501:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000662e02ea/0x825e3f5022b4a47d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a476 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892861.326509:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000662e02ea, rc 0) 00000100:00100000:3.0:1787892861.326546:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000db9fb47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+12:5846:x1874741455491072:12345-0@lo:101: Request processed in 105us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892861.326552:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787892861.326596:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bfd57d34 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455491072:0@lo:101: 00010000:00010000:3.0:1787892861.326615:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: 00000000fd4a15ef/0x825e3f5022b4a476 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a47d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892861.326622:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: 00000000fd4a15ef/0x825e3f5022b4a476 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a47d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892861.326674:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bfd57d34 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455491200:0@lo:501: 00000100:00100000:3.0:1787892861.326698:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892861.326712:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f2ae5aa0 going to sleep for 11 seconds 00000100:00100000:3.0:1787892861.326724:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455491200 00000100:00100000:3.0:1787892861.326727:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455491200 00000100:00100000:3.0:1787892861.326748:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787892861.326772:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bc16ebbb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+12:5846:x1874741455491200:12345-0@lo:501: 00000100:00100000:3.0:1787892861.329342:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bc16ebbb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+12:5846:x1874741455491200:12345-0@lo:501: Request processed in 2565us (2637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892861.329356:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787892861.333171:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bfd57d34 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455491200:0@lo:501: 00000100:00100000:0.0:1787892861.333238:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003a572f4f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455491328:0@lo:503: 00000100:00100000:0.0:1787892861.333314:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892861.333358:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ef208133 going to sleep for 11 seconds 00000100:00100000:0.0:1787892861.333463:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455491328 00000100:00100000:0.0:1787892861.333470:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455491328 00000100:00100000:0.0:1787892861.333518:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787892861.333527:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000007843d3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+12:5846:x1874741455491328:12345-0@lo:503: 00000100:00100000:0.0:1787892861.333709:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000007843d3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+12:5846:x1874741455491328:12345-0@lo:503: Request processed in 183us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892861.333718:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787892861.333788:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003a572f4f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455491328:0@lo:503: 00000100:00100000:1.0:1787892861.336262:0:6611:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000766acf1a pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:6611:1874741455491456:0@lo:502: 00000100:00100000:1.0:1787892861.336338:0:6611:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892861.336377:0:6611:0:(client.c:2715:ptlrpc_set_wait()) set 0000000070e1b0ec going to sleep for 11 seconds 00000100:00100000:2.0:1787892861.342127:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455491456 00000100:00100000:2.0:1787892861.342143:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455491456 00000100:00100000:2.0:1787892861.342198:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787892861.342207:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d5cc5dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+12:6611:x1874741455491456:12345-0@lo:502: 00000100:00100000:2.0:1787892861.342444:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d5cc5dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+12:6611:x1874741455491456:12345-0@lo:502: Request processed in 237us (6105us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892861.342452:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787892861.342511:0:6611:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000766acf1a pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:6611:1874741455491456:0@lo:502: 00000020:01000000:2.0:1787892861.342543:0:6611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787892861.342553:0:6611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787892861.342556:0:6611:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787892861.342565:0:6611:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90710510c800 00000020:00000080:2.0:1787892861.342567:0:6611:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787892861.342618:0:6611:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebc0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:6611:1874741455491584:0@lo:502: 00000100:00100000:2.0:1787892861.342663:0:6611:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892861.342698:0:6611:0:(client.c:2715:ptlrpc_set_wait()) set ffff907139e38240 going to sleep for 11 seconds 00000100:00100000:2.0:1787892861.342713:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455491584 00000100:00100000:2.0:1787892861.342717:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455491584 00000100:00100000:2.0:1787892861.342739:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787892861.342746:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+12:6611:x1874741455491584:12345-0@lo:502: 00000100:00100000:2.0:1787892861.342870:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+12:6611:x1874741455491584:12345-0@lo:502: Request processed in 123us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892861.342877:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787892861.342927:0:6611:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebc0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:6611:1874741455491584:0@lo:502: 00000020:01000000:2.0:1787892861.342945:0:6611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787892861.342950:0:6611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787892861.342951:0:6611:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787892861.342955:0:6611:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1787892861.343152:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787892861.343169:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787892861.343179:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff90710153a000/0x825e3f5022b4a476 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a47d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892861.343190:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff90710153a000/0x825e3f5022b4a476 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a47d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892862.025998:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787892862.153172:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787892862.157518:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907105afa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874741455491712:0@lo:400: 00000100:00100000:0.0:1787892862.157588:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892862.157697:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455491712 00000100:00100000:2.0:1787892862.157705:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455491712 00000100:00100000:2.0:1787892862.157775:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787892862.157795:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874741455491712:12345-0@lo:400: 00000100:00100000:2.0:1787892862.157852:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874741455491712:12345-0@lo:400: Request processed in 59us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892862.157872:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787892862.158146:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff907105afa300 x1874741455491712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892862.158161:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907105afa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874741455491712:0@lo:400: 00010000:00010000:0.0:1787892863.051465:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787892863.071258:0:6697:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787892863.071263:0:6697:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1787892863.071404:0:6697:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff907105af0000 00000020:01000004:0.0:1787892863.071421:0:6697:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1787892863.071435:0:6697:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1787892863.071448:0:6697:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff907105a8cd28) 00000020:00000080:0.0:1787892863.071463:0:6697:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787892863.122996:0:6697:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787892863.123304:0:6697:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1787892863.202743:0:6697:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1787892863.217363:0:6697:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787892863.217386:0:6697:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1787892863.217422:0:6697:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1787892863.217440:0:6697:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1787892863.217841:0:6697:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1787892863.217851:0:6697:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787892863.217860:0:6697:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x825e3f5022b4a48b 00000020:01000004:1.0:1787892863.217868:0:6697:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1787892863.217888:0:6697:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.129@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787892863.217891:0:6697:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787892863.217895:0:6697:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1787892863.217898:0:6697:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1787892863.217907:0:6697:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff90710734cd28) 00000020:00000080:1.0:1787892863.217918:0:6697:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:1.0:1787892863.219653:0:6697:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787892863.222495:0:6697:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1787892863.222501:0:6697:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1787892863.227249:0:6697:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1787892863.227263:0:6697:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1787892863.227728:0:6697:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787892863.227735:0:6697:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787892863.229259:0:6697:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787892863.229480:0:6697:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787892863.229486:0:6697:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1787892863.230596:0:6697:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1787892863.230605:0:6697:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787892863.260231:0:6697:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787892863.260522:0:6697:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787892863.260532:0:6697:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787892863.261721:0:6697:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787892863.261733:0:6697:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1787892863.264597:0:6697:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787892863.264613:0:6697:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787892863.268225:0:6697:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787892863.268452:0:6697:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787892863.268459:0:6697:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787892863.269196:0:6697:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787892863.269205:0:6697:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787892863.314266:0:6697:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787892863.314491:0:6697:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787892863.314499:0:6697:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787892863.315704:0:6697:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787892863.315720:0:6697:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787892863.316298:0:6697:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787892863.316322:0:6697:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1787892863.316329:0:6697:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.129@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787892863.342417:0:6697:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.129@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787892863.342457:0:6697:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.129@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1787892863.342462:0:6697:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787892863.342464:0:6697:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787892863.342466:0:6697:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787892863.342471:0:6697:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787892863.342472:0:6697:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787892863.342474:0:6697:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787892863.342475:0:6697:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787892863.342477:0:6697:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787892863.342478:0:6697:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787892863.342480:0:6697:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787892863.342481:0:6697:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787892863.342485:0:6697:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1787892863.342488:0:6697:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787892863.342489:0:6697:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787892863.342490:0:6697:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787892863.342491:0:6697:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787892863.342491:0:6697:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787892863.342492:0:6697:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787892863.342493:0:6697:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787892863.342494:0:6697:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787892863.342495:0:6697:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787892863.342496:0:6697:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787892863.342497:0:6697:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787892863.342527:0:6697:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787892863.342547:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:6697:1874741455491840:0@lo:253: 00000100:00100000:3.0:1787892863.342625:0:6697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892863.344592:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455491840 00000100:00100000:2.0:1787892863.344608:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455491840 00000100:00100000:3.0:1787892863.344658:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff907103f0ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1787892863.345031:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787892863.345043:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+12:6697:x1874741455491840:12345-0@lo:253: 20000000:01000000:2.0:1787892863.345092:0:5841:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787892863.345104:0:5841:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1787892863.345110:0:5841:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1787892863.345114:0:5841:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1787892863.345987:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787892863.346237:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1787892863.346251:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1787892863.346298:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1787892863.346306:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1787892863.346336:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1787892863.346386:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1787892863.346825:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1787892863.346847:0:5841:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.129@tcp 20000000:01000000:2.0:1787892863.346850:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.129@tcp (null) (null) (null) 00000040:00080000:2.0:1787892863.346889:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1787892863.346897:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787892863.346963:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1787892863.346973:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.129@tcp (null) (null) 00000040:00080000:2.0:1787892863.347019:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1787892863.347030:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787892863.347062:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1787892863.347116:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1787892863.347643:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1787892863.347654:0:5841:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.129@tcp 20000000:01000000:2.0:1787892863.347656:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.129@tcp (null) (null) (null) 00000040:00080000:2.0:1787892863.347688:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1787892863.347696:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787892863.347727:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1787892863.347735:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.129@tcp (null) (null) 00000040:00080000:2.0:1787892863.347807:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1787892863.347817:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787892863.347850:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1787892863.347887:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1787892863.347903:0:5841:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1787892863.347906:0:5841:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1787892863.347912:0:5841:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787892863.347914:0:5841:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787892863.347916:0:5841:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787892863.347928:0:5841:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787892863.347931:0:5841:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787892863.347960:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787892863.347963:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787892863.350796:0:6712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1787892863.351235:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1787892863.351286:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1787892863.351468:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1787892863.351483:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787892863.351487:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787892863.353029:0:6713:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1787892863.353099:0:6713:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1787892863.353152:0:6713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1787892863.353625:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1787892863.353684:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1787892863.353719:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1787892863.353733:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787892863.353735:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787892863.354644:0:6714:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:2.0:1787892863.354703:0:6714:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:2.0:1787892863.355009:0:6714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1787892863.355293:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1787892863.356044:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1787892863.356129:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 10000000:01000000:1.0:1787892863.356152:0:5841:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787892863.356172:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9071421fa600/0x825e3f5022b4a499 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892863.356190:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9071013fc600/0x825e3f5022b4a3b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a3ab expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892863.356198:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9071013fcc00/0x825e3f5022b4a3ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a3c7 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892863.356205:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907100031e00/0x825e3f5022b4a43e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a437 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892863.356213:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9071421fa600/0x825e3f5022b4a499 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892863.356252:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907100031e00/0x825e3f5022b4a43e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x825e3f5022b4a437 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892863.356268:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907100031e00/0x825e3f5022b4a43e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x825e3f5022b4a437 expref: 12 pid: 5843 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892863.356282:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907105afb800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1874741455491968:0@lo:104: 00000100:00100000:1.0:1787892863.356437:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787892863.356543:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9071013fcc00/0x825e3f5022b4a3ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x825e3f5022b4a3c7 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892863.356552:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9071013fcc00/0x825e3f5022b4a3ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x825e3f5022b4a3c7 expref: 12 pid: 5843 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892863.356561:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907105af9f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1874741455492096:0@lo:104: 00000100:00100000:1.0:1787892863.356602:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787892863.356715:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9071013fc600/0x825e3f5022b4a3b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x825e3f5022b4a3ab expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892863.356724:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9071013fc600/0x825e3f5022b4a3b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x825e3f5022b4a3ab expref: 12 pid: 5842 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892863.356732:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907105af8700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1874741455492224:0@lo:104: 00000100:00100000:1.0:1787892863.356781:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892863.356973:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455491968 00000100:00100000:2.0:1787892863.356981:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455491968 00000100:00100000:2.0:1787892863.357029:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455492096 00000100:00100000:2.0:1787892863.357033:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455492096 00000100:00100000:2.0:1787892863.357047:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787892863.357055:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105af9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22d910cf-711e-44e0-9acf-212404ada550+4:5841:x1874741455491968:12345-0@lo:104: 00010000:00010000:2.0:1787892863.357067:0:5831:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff907100031800/0x825e3f5022b4a437 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a43e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892863.357129:0:5831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787892863.357135:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105af9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22d910cf-711e-44e0-9acf-212404ada550+4:5841:x1874741455491968:12345-0@lo:104: Request processed in 81us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892863.357141:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787892863.357157:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787892863.357163:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105af8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22d910cf-711e-44e0-9acf-212404ada550+3:5841:x1874741455492096:12345-0@lo:104: 00010000:00010000:2.0:1787892863.357170:0:5831:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff90710153ba00/0x825e3f5022b4a3c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a3ce expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892863.357201:0:5831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787892863.357206:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105af8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22d910cf-711e-44e0-9acf-212404ada550+3:5841:x1874741455492096:12345-0@lo:104: Request processed in 44us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892863.357212:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1787892863.357231:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787892863.357244:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff907100031800/0x825e3f5022b4a437 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a43e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892863.357251:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907100031800 already unused, calling callback (ffffffffc1c05c20) 10000000:00010000:2.0:1787892863.357254:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff907100031800/0x825e3f5022b4a437 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x825e3f5022b4a43e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892863.357262:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff907100031800/0x825e3f5022b4a437 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x825e3f5022b4a43e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787892863.357269:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff907100031800/0x825e3f5022b4a437 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x825e3f5022b4a43e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892863.357275:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787892863.357318:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff907100031800/0x825e3f5022b4a437 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a43e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892863.357324:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787892863.357341:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff907100031800/0x825e3f5022b4a437 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a43e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892863.357347:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff907100031800/0x825e3f5022b4a437 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a43e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892863.357360:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787892863.357363:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff90710153ba00/0x825e3f5022b4a3c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a3ce expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892863.357368:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153ba00 already unused, calling callback (ffffffffc1c05c20) 10000000:00010000:2.0:1787892863.357371:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff90710153ba00/0x825e3f5022b4a3c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x825e3f5022b4a3ce expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892863.357387:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff90710153ba00/0x825e3f5022b4a3c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x825e3f5022b4a3ce expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787892863.357392:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff90710153ba00/0x825e3f5022b4a3c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x825e3f5022b4a3ce expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892863.357397:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787892863.357410:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff90710153ba00/0x825e3f5022b4a3c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a3ce expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892863.357414:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787892863.357420:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff90710153ba00/0x825e3f5022b4a3c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a3ce expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892863.357426:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff90710153ba00/0x825e3f5022b4a3c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a3ce expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892863.357435:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892863.357437:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892863.357438:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787892863.357458:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22d910cf-711e-44e0-9acf-212404ada550:3307:1874741455492352:0@lo:103: 00000100:00100000:2.0:1787892863.357488:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892863.357518:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787892863.357524:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22d910cf-711e-44e0-9acf-212404ada550:3307:1874741455492480:0@lo:103: 00000100:00100000:2.0:1787892863.357544:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892863.357579:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455492352 00000100:00100000:2.0:1787892863.357583:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455492352 00010000:00010000:2.0:1787892863.357601:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907100031e00/0x825e3f5022b4a43e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a437 expref: 13 pid: 5843 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892863.357634:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455492480 00000100:00100000:2.0:1787892863.357637:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455492480 00010000:00010000:2.0:1787892863.357649:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9071013fcc00/0x825e3f5022b4a3ce lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a3c7 expref: 14 pid: 5843 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892863.357660:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787892863.357666:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22d910cf-711e-44e0-9acf-212404ada550+14:3307:x1874741455492352:12345-0@lo:103: 00010000:00010000:2.0:1787892863.357675:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787892863.357681:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907100031e00/0x825e3f5022b4a43e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a437 expref: 14 pid: 5843 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892863.357690:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907100031e00/0x825e3f5022b4a43e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x825e3f5022b4a437 expref: 14 pid: 5843 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892863.357708:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787892863.357737:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22d910cf-711e-44e0-9acf-212404ada550+14:3307:x1874741455492352:12345-0@lo:103: Request processed in 71us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892863.357743:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787892863.357783:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787892863.357790:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22d910cf-711e-44e0-9acf-212404ada550+13:3307:x1874741455492480:12345-0@lo:103: 00010000:00010000:2.0:1787892863.357798:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787892863.357802:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9071013fcc00/0x825e3f5022b4a3ce lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a3c7 expref: 13 pid: 5843 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892863.357810:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9071013fcc00/0x825e3f5022b4a3ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x825e3f5022b4a3c7 expref: 13 pid: 5843 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892863.357819:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787892863.357859:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22d910cf-711e-44e0-9acf-212404ada550+13:3307:x1874741455492480:12345-0@lo:103: Request processed in 69us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892863.357865:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787892863.357900:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22d910cf-711e-44e0-9acf-212404ada550:3307:1874741455492480:0@lo:103: 00000100:00100000:2.0:1787892863.357908:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22d910cf-711e-44e0-9acf-212404ada550:3307:1874741455492352:0@lo:103: 00010000:00010000:3.0:1787892863.357977:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787892863.358184:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff90711b9739c0 going to sleep for 11 seconds 00010000:00010000:1.0:1787892863.358201:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907100031e00/0x825e3f5022b4a43e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x825e3f5022b4a437 expref: 12 pid: 5843 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892863.358211:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907105afb800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1874741455491968:0@lo:104: 00010000:00010000:1.0:1787892863.358221:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9071013fcc00/0x825e3f5022b4a3ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x825e3f5022b4a3c7 expref: 11 pid: 5843 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892863.358231:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907105af9f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1874741455492096:0@lo:104: 00000100:00100000:2.0:1787892863.358278:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455492224 00000100:00100000:2.0:1787892863.358283:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455492224 00000100:00100000:2.0:1787892863.358362:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787892863.358369:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105afad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22d910cf-711e-44e0-9acf-212404ada550+3:5841:x1874741455492224:12345-0@lo:104: 00010000:00010000:2.0:1787892863.358379:0:5831:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9071421fa800/0x825e3f5022b4a3ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a3b2 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892863.358470:0:5831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787892863.358476:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105afad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22d910cf-711e-44e0-9acf-212404ada550+3:5841:x1874741455492224:12345-0@lo:104: Request processed in 109us (1695us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892863.358482:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1787892863.358534:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787892863.358540:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9071421fa800/0x825e3f5022b4a3ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a3b2 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892863.358548:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fa800 already unused, calling callback (ffffffffc1c05c20) 10000000:00010000:3.0:1787892863.358551:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9071421fa800/0x825e3f5022b4a3ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x825e3f5022b4a3b2 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892863.358558:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9071421fa800/0x825e3f5022b4a3ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x825e3f5022b4a3b2 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787892863.358577:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9071421fa800/0x825e3f5022b4a3ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x825e3f5022b4a3b2 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787892863.358582:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787892863.358615:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9071421fa800/0x825e3f5022b4a3ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a3b2 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892863.358622:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787892863.358639:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9071421fa800/0x825e3f5022b4a3ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a3b2 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892863.358645:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9071421fa800/0x825e3f5022b4a3ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a3b2 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892863.358662:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787892863.358664:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787892863.358666:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787892863.358678:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455492608:0@lo:103: 00000100:00100000:3.0:1787892863.358709:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892863.358813:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455492608 00000100:00100000:2.0:1787892863.358818:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455492608 00010000:00010000:2.0:1787892863.358834:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9071013fc600/0x825e3f5022b4a3b2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a3ab expref: 11 pid: 5842 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892863.358857:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787892863.358863:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebbf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22d910cf-711e-44e0-9acf-212404ada550+11:3305:x1874741455492608:12345-0@lo:103: 00010000:00010000:2.0:1787892863.358872:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787892863.358876:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9071013fc600/0x825e3f5022b4a3b2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a3ab expref: 11 pid: 5842 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892863.358885:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9071013fc600/0x825e3f5022b4a3b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x825e3f5022b4a3ab expref: 11 pid: 5842 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892863.358906:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9071421fa600/0x825e3f5022b4a499 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892863.358913:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9071421fa600/0x825e3f5022b4a499 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892863.358926:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9071421fa600/0x825e3f5022b4a499 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892863.358933:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9071421fa600/0x825e3f5022b4a499 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892863.358938:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9071421fa600/0x825e3f5022b4a499 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892863.358944:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9071421fa600/0x825e3f5022b4a499 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892863.358949:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fa600 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:2.0:1787892863.358953:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9071421fa600/0x825e3f5022b4a499 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892863.358960:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9071421fa600/0x825e3f5022b4a499 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892863.358967:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9071421fa600/0x825e3f5022b4a499 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892863.358977:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787892863.359036:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebbf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22d910cf-711e-44e0-9acf-212404ada550+11:3305:x1874741455492608:12345-0@lo:103: Request processed in 172us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892863.359050:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787892863.359077:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455492608:0@lo:103: 00010000:00010000:1.0:1787892863.359840:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9071013fc600/0x825e3f5022b4a3b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x825e3f5022b4a3ab expref: 10 pid: 5842 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892863.359855:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907105af8700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1874741455492224:0@lo:104: 00010000:00010000:1.0:1787892863.359884:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9071421fa600/0x825e3f5022b4a499 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892863.359893:0:5841:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9071421fa600/0x825e3f5022b4a499 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892863.359899:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9071421fa600/0x825e3f5022b4a499 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892863.359905:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9071421fa600/0x825e3f5022b4a499 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787892863.359920:0:5841:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787892863.404732:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+9:6697:x1874741455491840:12345-0@lo:253: Request processed in 59682us (62097us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892863.404747:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787892863.404925:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:6697:1874741455491840:0@lo:253: 10000000:01000000:3.0:1787892863.404941:0:6697:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787892863.404944:0:6697:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787892863.404946:0:6697:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787892863.404947:0:6697:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787892863.404948:0:6697:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1787892863.404949:0:6697:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787892863.404950:0:6697:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787892863.404952:0:6697:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787892863.404953:0:6697:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787892863.404954:0:6697:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787892863.405029:0:6697:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787892863.405050:0:6697:0:(tgt_mount.c:101:server_register_mount()) register mount ffff907105af0000 from lustre-OST0000 10000000:01000000:3.0:1787892863.405090:0:6697:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1787892863.405094:0:6697:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787892863.405101:0:6697:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff907105a88000 local copy 10000000:01000000:3.0:1787892863.405105:0:6697:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787892863.405145:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff90710153b600/0x825e3f5022b4a4a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892863.405156:0:6697:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.129@tcp lock: ffff90710153b600/0x825e3f5022b4a4a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892863.405165:0:6697:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff90710153b600/0x825e3f5022b4a4a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892863.405183:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:6697:1874741455492736:0@lo:101: 00000100:00100000:3.0:1787892863.405223:0:6697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892863.405331:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff907105ce50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787892863.405543:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455492736 00000100:00100000:2.0:1787892863.405550:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455492736 00000100:00100000:2.0:1787892863.405634:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787892863.405644:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+9:6697:x1874741455492736:12345-0@lo:101: 00010000:00010000:2.0:1787892863.405658:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787892863.405673:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9071013fde00/0x825e3f5022b4a4a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4a4a0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892863.405699:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9071013fde00/0x825e3f5022b4a4a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4a4a0 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892863.405709:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9071013fde00/0x825e3f5022b4a4a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a4a0 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892863.405719:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071013fde00, rc 0) 00000100:00100000:2.0:1787892863.405828:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+10:6697:x1874741455492736:12345-0@lo:101: Request processed in 184us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892863.405834:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787892863.406038:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:6697:1874741455492736:0@lo:101: 00010000:00010000:3.0:1787892863.406054:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff90710153b600/0x825e3f5022b4a4a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x825e3f5022b4a4a7 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892863.406064:0:6697:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff90710153b600/0x825e3f5022b4a4a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x825e3f5022b4a4a7 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892863.406158:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:6697:1874741455492864:0@lo:501: 00000100:00100000:3.0:1787892863.406186:0:6697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892863.406252:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff907105ce50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787892863.406293:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455492864 00000100:00100000:0.0:1787892863.406298:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455492864 00000100:00100000:0.0:1787892863.406442:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787892863.406450:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+10:6697:x1874741455492864:12345-0@lo:501: 00000100:00100000:0.0:1787892863.406828:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+10:6697:x1874741455492864:12345-0@lo:501: Request processed in 377us (638us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787892863.406836:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787892863.406902:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:6697:1874741455492864:0@lo:501: 10000000:01000000:3.0:1787892863.406915:0:6697:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787892863.406953:0:6697:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787892863.406959:0:6697:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff90710153b600/0x825e3f5022b4a4a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x825e3f5022b4a4a7 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892863.407048:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff90710153b600/0x825e3f5022b4a4a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x825e3f5022b4a4a7 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892863.407056:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.129@tcp lock: ffff90710153b600/0x825e3f5022b4a4a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x825e3f5022b4a4a7 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892863.407118:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787892863.407144:0:6697:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff907105af0000 10000000:01000000:3.0:1787892863.407150:0:6697:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787892863.407156:0:6697:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff907105a88000 10000000:01000000:3.0:1787892863.407159:0:6697:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1787892863.407163:0:6697:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff907105a88000 from 1 10000000:01000000:3.0:1787892863.407165:0:6697:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1787892863.407189:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff90710153b400/0x825e3f5022b4a4ae lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892863.407196:0:6697:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff90710153b400/0x825e3f5022b4a4ae lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892863.407205:0:6697:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff90710153b400/0x825e3f5022b4a4ae lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892863.407219:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:6697:1874741455492992:0@lo:101: 00000100:00100000:3.0:1787892863.407252:0:6697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892863.407288:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff907105ce5480 going to sleep for 11 seconds 00000100:00100000:2.0:1787892863.407426:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455492992 00000100:00100000:2.0:1787892863.407432:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455492992 00000100:00100000:2.0:1787892863.407472:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787892863.407601:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+10:6697:x1874741455492992:12345-0@lo:101: 00010000:00010000:2.0:1787892863.407613:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787892863.407633:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9071013fc600/0x825e3f5022b4a4b5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4a4ae expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892863.407669:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9071013fc600/0x825e3f5022b4a4b5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4a4ae expref: 11 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892863.407681:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9071013fc600/0x825e3f5022b4a4b5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a4ae expref: 11 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892863.407690:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071013fc600, rc 0) 00000100:00100000:2.0:1787892863.407819:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+11:6697:x1874741455492992:12345-0@lo:101: Request processed in 338us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892863.407825:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1787892863.407892:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787892863.407898:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff90710153b600/0x825e3f5022b4a4a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x825e3f5022b4a4a7 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892863.407905:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153b600 already unused, calling callback (ffffffffc1c05c20) 10000000:00010000:0.0:1787892863.407909:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff90710153b600/0x825e3f5022b4a4a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x825e3f5022b4a4a7 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892863.407917:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff90710153b600/0x825e3f5022b4a4a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x825e3f5022b4a4a7 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787892863.407924:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff90710153b600/0x825e3f5022b4a4a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x825e3f5022b4a4a7 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787892863.407929:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787892863.407950:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff90710153b600/0x825e3f5022b4a4a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x825e3f5022b4a4a7 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892863.407956:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787892863.407994:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff90710153b600/0x825e3f5022b4a4a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x825e3f5022b4a4a7 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892863.408009:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff90710153b600/0x825e3f5022b4a4a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x825e3f5022b4a4a7 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892863.408033:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787892863.408035:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787892863.408036:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787892863.408088:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787892863.408101:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455493120:0@lo:103: 00000100:00100000:1.0:1787892863.408134:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892863.408255:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455493120 00000100:00100000:0.0:1787892863.408260:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455493120 00000100:00100000:0.0:1787892863.408299:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787892863.408316:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105af8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22d910cf-711e-44e0-9acf-212404ada550+11:3305:x1874741455493120:12345-0@lo:103: 00010000:00010000:0.0:1787892863.408325:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787892863.408336:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9071013fde00/0x825e3f5022b4a4a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x825e3f5022b4a4a0 expref: 11 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892863.408349:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787892863.408430:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105af8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22d910cf-711e-44e0-9acf-212404ada550+10:3305:x1874741455493120:12345-0@lo:103: Request processed in 115us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892863.408436:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787892863.408707:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455493120:0@lo:103: 00000100:00100000:3.0:1787892863.408888:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:6697:1874741455492992:0@lo:101: 00010000:00010000:3.0:1787892863.408912:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff90710153b400/0x825e3f5022b4a4ae lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a4b5 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892863.408922:0:6697:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff90710153b400/0x825e3f5022b4a4ae lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a4b5 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787892863.408939:0:6697:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787892863.409046:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff90710153b400/0x825e3f5022b4a4ae lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a4b5 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892863.409055:0:6697:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff90710153b400/0x825e3f5022b4a4ae lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a4b5 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787892863.409062:0:6697:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787892863.409067:0:6697:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787892863.409073:0:6697:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787892863.409075:0:6697:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787892863.409094:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff90710153a200/0x825e3f5022b4a4bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892863.409101:0:6697:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff90710153a200/0x825e3f5022b4a4bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892863.409109:0:6697:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff90710153a200/0x825e3f5022b4a4bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892863.409122:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:6697:1874741455493248:0@lo:101: 00000100:00100000:3.0:1787892863.409155:0:6697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892863.409187:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff907105ce5480 going to sleep for 11 seconds 00000100:00100000:0.0:1787892863.409243:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455493248 00000100:00100000:0.0:1787892863.409248:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455493248 00000100:00100000:0.0:1787892863.409286:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787892863.409294:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+10:6697:x1874741455493248:12345-0@lo:101: 00010000:00010000:0.0:1787892863.409377:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787892863.409390:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907100030c00/0x825e3f5022b4a4c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4a4bc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892863.409408:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907100030c00/0x825e3f5022b4a4c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4a4bc expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892863.409416:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907100030c00/0x825e3f5022b4a4c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a4bc expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892863.409435:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907100030c00, rc 0) 00000100:00100000:0.0:1787892863.409708:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+11:6697:x1874741455493248:12345-0@lo:101: Request processed in 414us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892863.409715:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787892863.409914:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:6697:1874741455493248:0@lo:101: 00010000:00010000:1.0:1787892863.409927:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff90710153a200/0x825e3f5022b4a4bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a4c3 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892863.409935:0:6697:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff90710153a200/0x825e3f5022b4a4bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a4c3 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892863.410183:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:6697:1874741455493376:0@lo:501: 00000100:00100000:0.0:1787892863.410214:0:6697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892863.410286:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff907107260480 going to sleep for 11 seconds 00000100:00100000:2.0:1787892863.410377:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455493376 00000100:00100000:2.0:1787892863.410382:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455493376 00000100:00100000:2.0:1787892863.410461:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787892863.410470:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+11:6697:x1874741455493376:12345-0@lo:501: 00000100:00100000:2.0:1787892863.410728:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+11:6697:x1874741455493376:12345-0@lo:501: Request processed in 259us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892863.410736:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787892863.410843:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:6697:1874741455493376:0@lo:501: 00000100:00100000:0.0:1787892863.410872:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:6697:1874741455493504:0@lo:503: 00000100:00100000:0.0:1787892863.410914:0:6697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892863.411156:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff907107260480 going to sleep for 11 seconds 00000100:00100000:3.0:1787892863.411247:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455493504 00000100:00100000:3.0:1787892863.411260:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455493504 00000100:00100000:3.0:1787892863.411286:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787892863.411293:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+11:6697:x1874741455493504:12345-0@lo:503: 00000100:00100000:3.0:1787892863.411484:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+11:6697:x1874741455493504:12345-0@lo:503: Request processed in 190us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892863.411491:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787892863.411644:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:6697:1874741455493504:0@lo:503: 00000040:00080000:0.0:1787892863.412159:0:6697:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787892863.412248:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:6697:1874741455493632:0@lo:502: 00000100:00100000:0.0:1787892863.412292:0:6697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892863.412463:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff907107260480 going to sleep for 11 seconds 00000100:00100000:2.0:1787892863.412596:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455493632 00000100:00100000:2.0:1787892863.412602:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455493632 00000100:00100000:2.0:1787892863.412635:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787892863.412643:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+11:6697:x1874741455493632:12345-0@lo:502: 00000100:00100000:2.0:1787892863.412845:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+11:6697:x1874741455493632:12345-0@lo:502: Request processed in 201us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892863.412852:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787892863.412987:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:6697:1874741455493632:0@lo:502: 00000040:00080000:0.0:1787892863.413274:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787892863.413340:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1787892863.413379:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1787892863.413432:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1787892863.413467:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1787892863.413498:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1787892863.413526:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:6697:1874741455493760:0@lo:502: 00000100:00100000:0.0:1787892863.413565:0:6697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892863.413599:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff907107260480 going to sleep for 11 seconds 00000100:00100000:2.0:1787892863.413809:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455493760 00000100:00100000:2.0:1787892863.413815:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455493760 00000100:00100000:2.0:1787892863.413843:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787892863.413857:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+11:6697:x1874741455493760:12345-0@lo:502: 00000100:00100000:2.0:1787892863.414067:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+11:6697:x1874741455493760:12345-0@lo:502: Request processed in 210us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892863.414073:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787892863.414165:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:6697:1874741455493760:0@lo:502: 00000040:00080000:0.0:1787892863.414248:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1787892863.414259:0:6697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1787892863.414848:0:6716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787892863.414858:0:6716:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1787892863.414866:0:6716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787892863.414868:0:6716:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787892863.414874:0:6716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787892863.414890:0:6716:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff907105a899b8) 00000020:00000080:0.0:1787892863.414920:0:6716:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787892863.414925:0:6716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787892863.415119:0:6716:0:(tgt_mount.c:153:server_get_mount()) get mount ffff907105af0000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787892863.415126:0:6716:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787892863.415134:0:6716:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x825e3f5022b4a4d1 00010000:00010000:0.0:1787892863.420257:0:6716:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1787892863.420609:0:6716:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1787892863.423943:0:6716:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1787892863.424379:0:6716:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1787892863.431200:0:6716:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1787892863.431817:0:6716:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1787892863.440877:0:6716:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787892863.440891:0:6716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787892863.440897:0:6716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787892863.440899:0:6716:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787892863.440903:0:6716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787892863.440907:0:6716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787892863.440908:0:6716:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787892863.440911:0:6716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787892863.440913:0:6716:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787892863.441105:0:6716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787892863.441109:0:6716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787892863.441111:0:6716:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787892863.441114:0:6716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787892863.441272:0:6697:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1787892863.441378:0:6697:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787892863.441400:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff90710153a200/0x825e3f5022b4a4bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a4c3 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892863.441412:0:6697:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff90710153a200/0x825e3f5022b4a4bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a4c3 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787892863.441420:0:6697:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff907105af0000 from 1 10000000:01000000:0.0:1787892863.441423:0:6697:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787892863.441461:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff907100030e00/0x825e3f5022b4a4d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892863.441482:0:6697:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff907100030e00/0x825e3f5022b4a4d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892863.441494:0:6697:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff907100030e00/0x825e3f5022b4a4d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892863.441517:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:6697:1874741455493888:0@lo:101: 00000100:00100000:0.0:1787892863.441591:0:6697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892863.441652:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071072600c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787892863.441787:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455493888 00000100:00100000:1.0:1787892863.441796:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455493888 00000100:00100000:1.0:1787892863.441840:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787892863.441849:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+11:6697:x1874741455493888:12345-0@lo:101: 00010000:00010000:1.0:1787892863.441864:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787892863.441883:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9071421fa600/0x825e3f5022b4a4df lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4a4d8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892863.441906:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9071421fa600/0x825e3f5022b4a4df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4a4d8 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892863.441916:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9071421fa600/0x825e3f5022b4a4df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a4d8 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892863.441926:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071421fa600, rc 0) 00000100:00100000:2.0:1787892863.442128:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:6697:1874741455493888:0@lo:101: 00010000:00010000:2.0:1787892863.442142:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff907100030e00/0x825e3f5022b4a4d8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a4df expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892863.442151:0:6697:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff907100030e00/0x825e3f5022b4a4d8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a4df expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892863.442249:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebc0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:6697:1874741455494016:0@lo:501: 00000100:00100000:2.0:1787892863.444204:0:6697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892863.444292:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710706ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1787892863.446040:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+12:6697:x1874741455493888:12345-0@lo:101: Request processed in 4184us (4442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892863.446052:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787892863.446103:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455494016 00000100:00100000:1.0:1787892863.446112:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455494016 00000100:00100000:0.0:1787892863.447837:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787892863.447925:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+12:6697:x1874741455494016:12345-0@lo:501: 00000100:00100000:0.0:1787892863.448509:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+12:6697:x1874741455494016:12345-0@lo:501: Request processed in 590us (4309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892863.448532:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787892863.449439:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebc0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:6697:1874741455494016:0@lo:501: 00000100:00100000:2.0:1787892863.449500:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebc0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:6697:1874741455494144:0@lo:503: 00000100:00100000:2.0:1787892863.449572:0:6697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892863.449612:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710706ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1787892863.449635:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455494144 00000100:00100000:2.0:1787892863.449643:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455494144 00000100:00100000:2.0:1787892863.449685:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787892863.449694:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+12:6697:x1874741455494144:12345-0@lo:503: 00000100:00100000:2.0:1787892863.450228:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+12:6697:x1874741455494144:12345-0@lo:503: Request processed in 534us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892863.450236:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787892863.450296:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebc0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:6697:1874741455494144:0@lo:503: 00000040:00080000:2.0:1787892863.452448:0:6697:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787892863.452577:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebc0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:6697:1874741455494272:0@lo:502: 00000100:00100000:2.0:1787892863.452656:0:6697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892863.452706:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff907110272e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787892863.453422:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455494272 00000100:00100000:3.0:1787892863.453434:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455494272 00000100:00100000:3.0:1787892863.453475:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787892863.453484:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+12:6697:x1874741455494272:12345-0@lo:502: 00000100:00100000:3.0:1787892863.453741:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+12:6697:x1874741455494272:12345-0@lo:502: Request processed in 256us (1084us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892863.453749:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787892863.457533:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebc0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:6697:1874741455494272:0@lo:502: 00000040:00080000:3.0:1787892863.458646:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787892863.458731:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787892863.459046:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:6697:1874741455494400:0@lo:502: 00000100:00100000:3.0:1787892863.459129:0:6697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892863.459214:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff90711031bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787892863.459293:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455494400 00000100:00100000:2.0:1787892863.459300:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455494400 00000100:00100000:2.0:1787892863.459461:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787892863.459470:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+12:6697:x1874741455494400:12345-0@lo:502: 00000100:00100000:2.0:1787892863.459694:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+12:6697:x1874741455494400:12345-0@lo:502: Request processed in 224us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892863.459702:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787892863.459888:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:6697:1874741455494400:0@lo:502: 00000040:00080000:3.0:1787892863.460126:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787892863.460138:0:6697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1787892863.460695:0:6720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787892863.460706:0:6720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787892863.460708:0:6720:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787892863.460715:0:6720:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff907105af0000 00000020:00000080:1.0:1787892863.460718:0:6720:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787892863.460738:0:6720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787892863.460741:0:6720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787892863.460742:0:6720:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787892863.460745:0:6720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1787892863.461470:0:6697:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787892863.461498:0:6697:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787892863.461551:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff907100030e00/0x825e3f5022b4a4d8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a4df expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892863.461563:0:6697:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff907100030e00/0x825e3f5022b4a4d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a4df expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787892863.461619:0:6697:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787892863.461622:0:6697:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff907105af0000 10000000:01000000:3.0:1787892863.461625:0:6697:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff907105af0000 10000000:01000000:3.0:1787892863.461629:0:6697:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787892863.461636:0:6697:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff907105af0000 from 1 10000000:01000000:3.0:1787892863.461639:0:6697:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787892863.461670:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff90710153b000/0x825e3f5022b4a4e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892863.461679:0:6697:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff90710153b000/0x825e3f5022b4a4e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892863.461690:0:6697:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff90710153b000/0x825e3f5022b4a4e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892863.461710:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:6697:1874741455494528:0@lo:101: 00000100:00100000:3.0:1787892863.461903:0:6697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892863.461944:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff90711031ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1787892863.462118:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455494528 00000100:00100000:1.0:1787892863.462126:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455494528 00000100:00100000:1.0:1787892863.462170:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787892863.462179:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+12:6697:x1874741455494528:12345-0@lo:101: 00010000:00010000:1.0:1787892863.462191:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787892863.462204:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9071421fa000/0x825e3f5022b4a4ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4a4e6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892863.462241:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9071421fa000/0x825e3f5022b4a4ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4a4e6 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892863.462251:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9071421fa000/0x825e3f5022b4a4ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a4e6 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892863.462260:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071421fa000, rc 0) 00000100:00100000:1.0:1787892863.462415:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+13:6697:x1874741455494528:12345-0@lo:101: Request processed in 237us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892863.462422:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787892863.462492:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:6697:1874741455494528:0@lo:101: 00010000:00010000:3.0:1787892863.462507:0:6697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff90710153b000/0x825e3f5022b4a4e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a4ed expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892863.462515:0:6697:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff90710153b000/0x825e3f5022b4a4e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a4ed expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892863.462603:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:6697:1874741455494656:0@lo:501: 00000100:00100000:3.0:1787892863.462630:0:6697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892863.462663:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff90711031ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1787892863.462717:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455494656 00000100:00100000:0.0:1787892863.462721:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455494656 00000100:00100000:0.0:1787892863.462848:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787892863.462858:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+13:6697:x1874741455494656:12345-0@lo:501: 00000100:00100000:0.0:1787892863.463154:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+13:6697:x1874741455494656:12345-0@lo:501: Request processed in 297us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892863.463160:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787892863.463395:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:6697:1874741455494656:0@lo:501: 00000100:00100000:3.0:1787892863.463422:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:6697:1874741455494784:0@lo:503: 00000100:00100000:3.0:1787892863.463457:0:6697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892863.463485:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff90711031ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1787892863.463523:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455494784 00000100:00100000:1.0:1787892863.463527:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455494784 00000100:00100000:1.0:1787892863.463545:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787892863.463551:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+13:6697:x1874741455494784:12345-0@lo:503: 00000100:00100000:1.0:1787892863.463690:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+13:6697:x1874741455494784:12345-0@lo:503: Request processed in 138us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892863.463697:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787892863.463887:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:6697:1874741455494784:0@lo:503: 00000040:00080000:3.0:1787892863.464204:0:6697:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787892863.464256:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:6697:1874741455494912:0@lo:502: 00000100:00100000:3.0:1787892863.464287:0:6697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892863.464409:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455494912 00000100:00100000:1.0:1787892863.464414:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455494912 00000100:00100000:1.0:1787892863.464439:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787892863.464445:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+13:6697:x1874741455494912:12345-0@lo:502: 00000100:00100000:1.0:1787892863.464604:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+13:6697:x1874741455494912:12345-0@lo:502: Request processed in 158us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892863.464611:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787892863.464707:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff90711031ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1787892863.464722:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:6697:1874741455494912:0@lo:502: 00000040:00080000:3.0:1787892863.465280:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787892863.465398:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787892863.465440:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787892863.465480:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787892863.465510:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787892863.465546:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787892863.465574:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787892863.465600:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787892863.465651:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787892863.465686:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787892863.465717:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787892863.466248:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787892863.466290:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787892863.466383:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787892863.466427:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787892863.466457:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787892863.466484:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787892863.466520:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787892863.466570:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787892863.466598:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787892863.466648:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787892863.466680:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787892863.466711:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787892863.467132:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787892863.467176:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1787892863.467213:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1787892863.467266:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1787892863.467371:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1787892863.467421:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:6697:1874741455495040:0@lo:502: 00000100:00100000:3.0:1787892863.467494:0:6697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892863.467583:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff90711031ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1787892863.467632:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455495040 00000100:00100000:0.0:1787892863.467642:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455495040 00000100:00100000:0.0:1787892863.467728:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787892863.467738:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+13:6697:x1874741455495040:12345-0@lo:502: 00000100:00100000:0.0:1787892863.468396:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+13:6697:x1874741455495040:12345-0@lo:502: Request processed in 658us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892863.468405:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787892863.468494:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:6697:1874741455495040:0@lo:502: 00000040:00080000:3.0:1787892863.468575:0:6697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1787892863.468585:0:6697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1787892863.469228:0:6721:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787892863.469244:0:6721:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff90711badb370) 00000020:00000080:2.0:1787892863.469265:0:6721:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1787892863.469363:0:6721:0:(tgt_mount.c:153:server_get_mount()) get mount ffff907105af0000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787892863.469367:0:6721:0:(tgt_mount.c:187:server_put_mount()) put mount ffff907105af0000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787892863.469370:0:6721:0:(obd_mount.c:710:lustre_put_lsi()) put ffff907105af0000 3 00010000:00080000:2.0:1787892863.469398:0:6721:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90713f77e800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.129@tcp at head 00010000:00010000:2.0:1787892863.473393:0:6721:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1787892863.473660:0:6721:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787892863.473698:0:6721:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787892863.473710:0:6721:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x825e3f5022b4a4fb 00000100:00080000:2.0:1787892863.473722:0:6721:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787892863.473728:0:6721:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90713f77e800 using connection 192.168.202.129@tcp/0@lo 00000100:00100000:2.0:1787892863.473874:0:6721:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90712ebc3100 x1874741455495168/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787892863.473908:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1874741455495168:0@lo:38: 00000100:00100000:2.0:1787892863.474069:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787892863.474133:0:6721:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787892863.474185:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874741455495296:0@lo:400: 00000100:00100000:2.0:1787892863.474214:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892863.474255:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455495168 00000100:00100000:2.0:1787892863.474263:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455495168 00000100:00100000:2.0:1787892863.474289:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455495296 00000100:00100000:2.0:1787892863.474292:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455495296 00000100:00100000:2.0:1787892863.474492:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787892863.474502:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874741455495296:12345-0@lo:400: 00000100:00100000:2.0:1787892863.474555:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874741455495296:12345-0@lo:400: Request processed in 55us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892863.474563:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787892863.474578:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787892863.474582:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1874741455495168:12345-0@lo:38: 00010000:00080000:2.0:1787892863.474609:0:5849:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:2.0:1787892863.474638:0:5849:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x825e3f5022b4a502 00000004:00100000:2.0:1787892863.474652:0:5849:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787892863.474680:0:5849:0:(import.c:65:import_set_state_nolock()) ffff90713f77a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787892863.474722:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874741455495168:12345-0@lo:38: Request processed in 137us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892863.474728:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787892863.474934:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90712ebc0e00 x1874741455495296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892863.474951:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874741455495296:0@lo:400: 00010000:00080000:2.0:1787892863.475062:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90712ebc3100 x1874741455495168/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787892873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892863.475071:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787892863.475077:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1787892863.475084:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787892863.475088:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787892863.475090:0:3304:0:(import.c:65:import_set_state_nolock()) ffff90713f77e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787892863.475095:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1874741455495168:0@lo:38: 00000040:00080000:2.0:1787892863.475605:0:6721:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:3.0:1787892863.478930:0:6697:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1787892863.479107:0:6697:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787892863.479131:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff90710153b000/0x825e3f5022b4a4e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a4ed expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892863.479146:0:6697:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff90710153b000/0x825e3f5022b4a4e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a4ed expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787892863.479202:0:6697:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787892863.479204:0:6697:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787892863.479206:0:6697:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787892863.479207:0:6697:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787892863.479208:0:6697:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787892863.479209:0:6697:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787892863.479211:0:6697:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787892863.479213:0:6697:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787892863.479219:0:6697:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787892863.479220:0:6697:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787892863.479222:0:6697:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787892863.479226:0:6697:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1787892863.479229:0:6697:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787892863.479230:0:6697:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787892863.479231:0:6697:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787892863.479232:0:6697:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787892863.479232:0:6697:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787892863.479233:0:6697:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787892863.479234:0:6697:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787892863.479235:0:6697:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787892863.479236:0:6697:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787892863.479236:0:6697:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787892863.479237:0:6697:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787892863.479267:0:6697:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787892863.479286:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:6697:1874741455495424:0@lo:253: 00000100:00100000:3.0:1787892863.479369:0:6697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892863.479421:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff90711217b000 going to sleep for 11 seconds 00000100:00100000:1.0:1787892863.479561:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455495424 00000100:00100000:1.0:1787892863.479569:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455495424 00000100:00100000:1.0:1787892863.479621:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787892863.479638:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+13:6697:x1874741455495424:12345-0@lo:253: 20000000:01000000:1.0:1787892863.479678:0:5842:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787892863.479695:0:5842:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787892863.514648:0:5842:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787892863.514692:0:5842:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787892863.516618:0:5863:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787892863.516629:0:5863:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787892863.516654:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9071013fcc00/0x825e3f5022b4a509 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892863.516677:0:5863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90710153b200/0x825e3f5022b4a461 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a45a expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892863.516710:0:5863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9071013fcc00/0x825e3f5022b4a509 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892863.516788:0:5863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90710153b200/0x825e3f5022b4a461 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x825e3f5022b4a45a expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892863.516804:0:5863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90710153b200/0x825e3f5022b4a461 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x825e3f5022b4a45a expref: 13 pid: 5843 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892863.516819:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebc3100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5863:1874741455495552:0@lo:104: 00000100:00100000:2.0:1787892863.516886:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892863.516943:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffff907110272f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787892863.517148:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455495552 00000100:00100000:3.0:1787892863.517157:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455495552 00000100:00100000:3.0:1787892863.517207:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787892863.517217:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22d910cf-711e-44e0-9acf-212404ada550+3:5863:x1874741455495552:12345-0@lo:104: 00010000:00010000:3.0:1787892863.517230:0:5831:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9071421fa400/0x825e3f5022b4a45a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a461 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892863.517294:0:5831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787892863.517301:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22d910cf-711e-44e0-9acf-212404ada550+3:5863:x1874741455495552:12345-0@lo:104: Request processed in 86us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892863.517308:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1787892863.517330:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787892863.517335:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9071421fa400/0x825e3f5022b4a45a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a461 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892863.517355:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fa400 already unused, calling callback (ffffffffc1c05c20) 10000000:00010000:3.0:1787892863.517359:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9071421fa400/0x825e3f5022b4a45a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x825e3f5022b4a461 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892863.517367:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9071421fa400/0x825e3f5022b4a45a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x825e3f5022b4a461 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787892863.517375:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9071421fa400/0x825e3f5022b4a45a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x825e3f5022b4a461 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787892863.517380:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787892863.517412:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9071421fa400/0x825e3f5022b4a45a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a461 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892863.517418:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787892863.517436:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9071421fa400/0x825e3f5022b4a45a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a461 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892863.517441:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9071421fa400/0x825e3f5022b4a45a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a461 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892863.517461:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787892863.517463:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787892863.517465:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787892863.517482:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22d910cf-711e-44e0-9acf-212404ada550:3308:1874741455495680:0@lo:103: 00000100:00100000:3.0:1787892863.517516:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892863.517568:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455495680 00000100:00100000:3.0:1787892863.517572:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455495680 00010000:00010000:3.0:1787892863.517590:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90710153b200/0x825e3f5022b4a461 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a45a expref: 14 pid: 5843 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892863.517622:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787892863.517628:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107f28050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22d910cf-711e-44e0-9acf-212404ada550+14:3308:x1874741455495680:12345-0@lo:103: 00010000:00010000:3.0:1787892863.517640:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787892863.517645:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90710153b200/0x825e3f5022b4a461 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a45a expref: 14 pid: 5843 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892863.517656:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90710153b200/0x825e3f5022b4a461 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x825e3f5022b4a45a expref: 14 pid: 5843 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892863.517674:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9071013fcc00/0x825e3f5022b4a509 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892863.517682:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9071013fcc00/0x825e3f5022b4a509 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787892863.517697:0:5833:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001254390s 00010000:00010000:3.0:1787892863.517701:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9071013fcc00/0x825e3f5022b4a509 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892863.517708:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9071013fcc00/0x825e3f5022b4a509 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892863.517715:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9071013fcc00/0x825e3f5022b4a509 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892863.517722:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9071013fcc00/0x825e3f5022b4a509 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892863.517728:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071013fcc00 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:3.0:1787892863.517733:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9071013fcc00/0x825e3f5022b4a509 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892863.517746:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9071013fcc00/0x825e3f5022b4a509 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892863.517788:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9071013fcc00/0x825e3f5022b4a509 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892863.517799:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787892863.517830:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107f28050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22d910cf-711e-44e0-9acf-212404ada550+14:3308:x1874741455495680:12345-0@lo:103: Request processed in 202us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892863.517837:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787892863.517897:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22d910cf-711e-44e0-9acf-212404ada550:3308:1874741455495680:0@lo:103: 00010000:00010000:2.0:1787892863.518189:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90710153b200/0x825e3f5022b4a461 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x825e3f5022b4a45a expref: 13 pid: 5843 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892863.518202:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebc3100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5863:1874741455495552:0@lo:104: 00010000:00010000:2.0:1787892863.518215:0:5863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9071013fcc00/0x825e3f5022b4a509 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892863.518224:0:5863:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9071013fcc00/0x825e3f5022b4a509 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892863.518229:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9071013fcc00/0x825e3f5022b4a509 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892863.518235:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9071013fcc00/0x825e3f5022b4a509 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892863.526623:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+12:6697:x1874741455495424:12345-0@lo:253: Request processed in 46978us (47244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892863.526648:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787892863.526747:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:6697:1874741455495424:0@lo:253: 10000000:01000000:3.0:1787892863.530244:0:6697:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787892863.530249:0:6697:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787892863.530250:0:6697:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787892863.530252:0:6697:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787892863.530253:0:6697:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787892863.530255:0:6697:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787892863.530257:0:6697:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787892863.530258:0:6697:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787892863.530259:0:6697:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787892863.530260:0:6697:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787892863.530262:0:6697:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787892863.530264:0:6697:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787892863.530280:0:6697:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787892863.537216:0:6697:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787892863.537394:0:6697:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787892863.537564:0:6697:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787892863.537741:0:6697:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787892863.538573:0:6697:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787892863.540257:0:6697:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787892863.546412:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1787892863.846340:0:6697:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787892863.846349:0:6697:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787892863.846387:0:6697:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787892863.846444:0:6697:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.129@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787892863.846458:0:6697:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1787892863.846488:0:6697:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1787892864.073162:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787892865.097119:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892866.122931:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787892867.147418:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892868.173161:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787892868.808963:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874741455495936:0@lo:400: 00000100:00100000:2.0:1787892868.809050:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892868.809106:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787892868.809113:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22d910cf-711e-44e0-9acf-212404ada550:3306:1874741455495808:0@lo:400: 00000100:00100000:2.0:1787892868.809144:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892868.809168:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874741455496064:0@lo:400: 00000100:00100000:2.0:1787892868.809191:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892868.809227:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455495936 00000100:00100000:2.0:1787892868.809248:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455495936 00000100:00100000:2.0:1787892868.809291:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455496064 00000100:00100000:2.0:1787892868.809295:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455496064 00000100:00100000:2.0:1787892868.809330:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787892868.809338:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874741455495936:12345-0@lo:400: 00000100:00100000:2.0:1787892868.809385:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874741455495936:12345-0@lo:400: Request processed in 48us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892868.809403:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787892868.809417:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787892868.809421:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874741455496064:12345-0@lo:400: 00000100:00100000:2.0:1787892868.809441:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874741455496064:12345-0@lo:400: Request processed in 20us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892868.809444:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787892868.809472:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90712ebc1180 x1874741455496064/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892868.809486:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874741455496064:0@lo:400: 00010000:00080000:2.0:1787892868.809514:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90712ebc2a00 x1874741455495936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892868.809523:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874741455495936:0@lo:400: 00000100:00100000:0.0:1787892868.809838:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455495808 00000100:00100000:0.0:1787892868.809843:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455495808 00000100:00100000:0.0:1787892868.809868:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787892868.809874:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+12:3306:x1874741455495808:12345-0@lo:400: 00000100:00100000:0.0:1787892868.809914:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+12:3306:x1874741455495808:12345-0@lo:400: Request processed in 40us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892868.809920:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787892868.809967:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22d910cf-711e-44e0-9acf-212404ada550:3306:1874741455495808:0@lo:400: 00000100:00080000:0.0:1787892868.810811:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787892869.192924:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787892870.217094:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787892870.355951:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787892870.355965:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90710510c800 from 21 10000000:01000000:2.0:1787892870.355970:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787892870.356020:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9071013fc800/0x825e3f5022b4a510 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892870.356032:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9071013fc800/0x825e3f5022b4a510 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892870.356045:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9071013fc800/0x825e3f5022b4a510 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892870.356072:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebc2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455496192:0@lo:101: 00000100:00100000:2.0:1787892870.356141:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892870.356222:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff90711217bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787892870.356384:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455496192 00000100:00100000:1.0:1787892870.356394:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455496192 00000100:00100000:1.0:1787892870.356456:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787892870.356479:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+12:5846:x1874741455496192:12345-0@lo:101: 00010000:00010000:1.0:1787892870.356496:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787892870.356509:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9071421fa800/0x825e3f5022b4a517 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4a510 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892870.356534:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9071421fa800/0x825e3f5022b4a517 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4a510 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892870.356549:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9071421fa800/0x825e3f5022b4a517 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a510 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892870.356569:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071421fa800, rc 0) 00000100:00100000:1.0:1787892870.356615:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+13:5846:x1874741455496192:12345-0@lo:101: Request processed in 138us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892870.356622:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787892870.357224:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebc2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455496192:0@lo:101: 00010000:00010000:2.0:1787892870.357244:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9071013fc800/0x825e3f5022b4a510 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a517 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892870.357359:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9071013fc800/0x825e3f5022b4a510 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a517 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892870.357427:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebc2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455496320:0@lo:501: 00000100:00100000:2.0:1787892870.357529:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892870.358615:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff90711217bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787892870.368241:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455496320 00000100:00100000:1.0:1787892870.368276:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455496320 00000100:00100000:0.0:1787892870.384922:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787892870.384956:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+13:5846:x1874741455496320:12345-0@lo:501: 00000100:00100000:0.0:1787892870.385367:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+13:5846:x1874741455496320:12345-0@lo:501: Request processed in 431us (27836us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892870.386226:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebc2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455496320:0@lo:501: 00000100:00100000:1.0:1787892870.386286:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907105af9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455496448:0@lo:503: 00000100:00100000:1.0:1787892870.386351:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892870.386387:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455496448 00000100:00100000:1.0:1787892870.386392:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455496448 00000100:00100000:0.0:1787892870.394662:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787892870.397715:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787892870.397740:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+13:5846:x1874741455496448:12345-0@lo:503: 00000100:00100000:1.0:1787892870.398332:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+13:5846:x1874741455496448:12345-0@lo:503: Request processed in 602us (11978us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892870.398341:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787892870.398420:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071103b7000 going to sleep for 11 seconds 00000100:00100000:1.0:1787892870.398583:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907105af9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455496448:0@lo:503: 00000100:00100000:1.0:1787892870.400300:0:7018:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907105af9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:7018:1874741455496576:0@lo:502: 00000100:00100000:1.0:1787892870.400381:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892870.400423:0:7018:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071103b7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787892870.400432:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455496576 00000100:00100000:0.0:1787892870.400440:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455496576 00000100:00100000:0.0:1787892870.400488:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787892870.400499:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+13:7018:x1874741455496576:12345-0@lo:502: 00000100:00100000:0.0:1787892870.400867:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+13:7018:x1874741455496576:12345-0@lo:502: Request processed in 368us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892870.400876:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787892870.400888:0:7018:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907105af9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:7018:1874741455496576:0@lo:502: 00000100:00100000:1.0:1787892870.400955:0:7018:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907105af9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:7018:1874741455496704:0@lo:502: 00000100:00100000:1.0:1787892870.400990:0:7018:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892870.401012:0:7018:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071103b7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787892870.401116:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455496704 00000100:00100000:2.0:1787892870.401121:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455496704 00000100:00100000:2.0:1787892870.401156:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787892870.401164:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+13:7018:x1874741455496704:12345-0@lo:502: 00000100:00100000:2.0:1787892870.401311:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+13:7018:x1874741455496704:12345-0@lo:502: Request processed in 148us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892870.401318:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787892870.405304:0:7018:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907105af9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:7018:1874741455496704:0@lo:502: 00000040:00080000:0.0:1787892870.405377:0:7018:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1787892870.405542:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1787892870.405571:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787892870.405583:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9071013fc800/0x825e3f5022b4a510 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a517 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892870.405595:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9071013fc800/0x825e3f5022b4a510 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a517 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892870.405607:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787892870.405610:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90710510c800 from 4 10000000:01000000:2.0:1787892870.405613:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787892870.405672:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9071013fd400/0x825e3f5022b4a51e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892870.405682:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9071013fd400/0x825e3f5022b4a51e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892870.405692:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9071013fd400/0x825e3f5022b4a51e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892870.405713:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebc1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455496832:0@lo:101: 00000100:00100000:2.0:1787892870.405804:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892870.405835:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff90711217bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787892870.405964:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455496832 00000100:00100000:0.0:1787892870.405971:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455496832 00000100:00100000:0.0:1787892870.406021:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787892870.406031:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+13:5846:x1874741455496832:12345-0@lo:101: 00010000:00010000:0.0:1787892870.406044:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787892870.406058:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907100031800/0x825e3f5022b4a525 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4a51e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892870.406082:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907100031800/0x825e3f5022b4a525 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4a51e expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892870.406093:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907100031800/0x825e3f5022b4a525 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a51e expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892870.406102:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907100031800, rc 0) 00000100:00100000:0.0:1787892870.406153:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+14:5846:x1874741455496832:12345-0@lo:101: Request processed in 123us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892870.406160:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787892870.406489:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebc1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455496832:0@lo:101: 00010000:00010000:1.0:1787892870.406508:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9071013fd400/0x825e3f5022b4a51e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a525 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892870.406518:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9071013fd400/0x825e3f5022b4a51e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a525 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892870.406571:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907105afb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455496960:0@lo:256: 00000100:00100000:1.0:1787892870.406617:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892870.406659:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071103b76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787892870.406798:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455496960 00000100:00100000:2.0:1787892870.406803:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455496960 00000100:00100000:2.0:1787892870.406836:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787892870.406843:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+14:5846:x1874741455496960:12345-0@lo:256: 20000000:01000000:2.0:1787892870.406858:0:5842:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787892870.406875:0:5842:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787892870.406879:0:5842:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1787892870.406985:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+14:5846:x1874741455496960:12345-0@lo:256: Request processed in 142us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892870.406993:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787892870.407363:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907105afb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455496960:0@lo:256: 10000000:01000000:3.0:1787892870.407423:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787892870.407435:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9071013fd400/0x825e3f5022b4a51e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a525 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892870.407444:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9071013fd400/0x825e3f5022b4a51e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a525 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787892870.407453:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787892870.407456:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1787892870.407459:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787892870.407487:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff90710153aa00/0x825e3f5022b4a52c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892870.407495:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff90710153aa00/0x825e3f5022b4a52c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892870.407505:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff90710153aa00/0x825e3f5022b4a52c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892870.407520:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455497088:0@lo:101: 00000100:00100000:3.0:1787892870.407562:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892870.407595:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff907109145600 going to sleep for 11 seconds 00000100:00100000:1.0:1787892870.407610:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455497088 00000100:00100000:1.0:1787892870.407615:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455497088 00000100:00100000:1.0:1787892870.407657:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787892870.407664:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907113ea9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+14:5846:x1874741455497088:12345-0@lo:101: 00010000:00010000:1.0:1787892870.407673:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787892870.407685:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9071421fae00/0x825e3f5022b4a533 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4a52c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892870.407703:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9071421fae00/0x825e3f5022b4a533 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4a52c expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892870.407711:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9071421fae00/0x825e3f5022b4a533 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a52c expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892870.407719:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071421fae00, rc 0) 00000100:00100000:1.0:1787892870.407982:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907113ea9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+15:5846:x1874741455497088:12345-0@lo:101: Request processed in 317us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892870.407989:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787892870.410903:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455497088:0@lo:101: 00010000:00010000:0.0:1787892870.410946:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff90710153aa00/0x825e3f5022b4a52c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a533 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892870.410959:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff90710153aa00/0x825e3f5022b4a52c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a533 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892870.411482:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455497216:0@lo:501: 00000100:00100000:1.0:1787892870.411548:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892870.411601:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071103b7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787892870.411653:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455497216 00000100:00100000:0.0:1787892870.411660:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455497216 00000100:00100000:0.0:1787892870.411713:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787892870.411743:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907119795450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+15:5846:x1874741455497216:12345-0@lo:501: 00000100:00100000:0.0:1787892870.412069:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907119795450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+15:5846:x1874741455497216:12345-0@lo:501: Request processed in 327us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892870.412076:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787892870.412494:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455497216:0@lo:501: 00000100:00100000:1.0:1787892870.412534:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907105afb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455497344:0@lo:503: 00000100:00100000:1.0:1787892870.412576:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892870.412605:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071103b7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787892870.412652:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455497344 00000100:00100000:0.0:1787892870.412658:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455497344 00000100:00100000:0.0:1787892870.412693:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787892870.412701:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907119795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+15:5846:x1874741455497344:12345-0@lo:503: 00000100:00100000:0.0:1787892870.413047:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907119795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+15:5846:x1874741455497344:12345-0@lo:503: Request processed in 345us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892870.413054:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787892870.413554:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907105afb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455497344:0@lo:503: 00000100:00100000:1.0:1787892870.413826:0:7021:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907105afb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:7021:1874741455497472:0@lo:502: 00000100:00100000:1.0:1787892870.413871:0:7021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892870.413902:0:7021:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071103b7180 going to sleep for 11 seconds 00000100:00100000:0.0:1787892870.414898:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455497472 00000100:00100000:0.0:1787892870.414910:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455497472 00000100:00100000:0.0:1787892870.414969:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787892870.414979:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907119794050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+15:7021:x1874741455497472:12345-0@lo:502: 00000100:00100000:0.0:1787892870.415357:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907119794050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+15:7021:x1874741455497472:12345-0@lo:502: Request processed in 379us (1484us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892870.415365:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787892870.415389:0:7021:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907105afb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:7021:1874741455497472:0@lo:502: 00000020:01000000:1.0:1787892870.415419:0:7021:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787892870.415427:0:7021:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787892870.415453:0:7021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787892870.415456:0:7021:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787892870.415461:0:7021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787892870.415465:0:7021:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.129@tcp to nid 0x20000c0a8ca81 (192.168.202.129@tcp) 00000020:01000000:1.0:1787892870.415489:0:7021:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787892870.415492:0:7021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787892870.415522:0:7021:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff907107ef99b8) 00000020:00000080:1.0:1787892870.415543:0:7021:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1787892870.415551:0:7021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787892870.415642:0:7021:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1787892870.415649:0:7021:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787892870.415656:0:7021:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x825e3f5022b4a541 00010000:00080000:1.0:1787892870.415691:0:7021:0:(ldlm_lib.c:102:import_set_conn()) imp ffff907129bbe800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.129@tcp at head 00010000:00010000:1.0:1787892870.416106:0:7021:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1787892870.508422:0:7021:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787892870.508447:0:7021:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787892870.509045:0:7021:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787892870.509228:0:7021:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787892870.509286:0:7021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1787892870.509356:0:7021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1787892870.510162:0:7026:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787892870.510168:0:7026:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787892870.510861:0:7021:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787892870.510874:0:7021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787892870.511088:0:7021:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787892870.511116:0:7021:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x825e3f5022b4a548 00000100:00080000:0.0:1787892870.511128:0:7021:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787892870.511136:0:7021:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff907129bbe800 using connection 192.168.202.129@tcp/0@lo 00000100:00100000:0.0:1787892870.511175:0:7021:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90712e2f2300 x1874741455497600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787892870.511238:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874741455497600:0@lo:8: 00000100:00100000:1.0:1787892870.511318:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787892870.511398:0:7021:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787892870.511482:0:7021:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787892870.511487:0:7021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787892870.511488:0:7021:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787892870.511492:0:7021:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787892870.511496:0:7021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787892870.511498:0:7021:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787892870.511501:0:7021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787892870.511503:0:7021:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787892870.511528:0:7021:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:7021:1874741455497728:0@lo:502: 00000100:00100000:0.0:1787892870.511574:0:7021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892870.511590:0:7021:0:(client.c:2715:ptlrpc_set_wait()) set ffff907107260780 going to sleep for 11 seconds 00000100:00100000:0.0:1787892870.511653:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455497728 00000100:00100000:0.0:1787892870.511658:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455497728 00000100:00100000:0.0:1787892870.511697:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787892870.511706:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907106340050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+15:7021:x1874741455497728:12345-0@lo:502: 00000100:00100000:0.0:1787892870.511975:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907106340050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+15:7021:x1874741455497728:12345-0@lo:502: Request processed in 268us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892870.511983:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787892870.512036:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874741455497856:0@lo:400: 00000100:00100000:0.0:1787892870.512063:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892870.512096:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874741455497984:0@lo:400: 00000100:00100000:0.0:1787892870.512119:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892870.512168:0:7021:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:7021:1874741455497728:0@lo:502: 00000020:01000000:0.0:1787892870.512194:0:7021:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787892870.512200:0:7021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787892870.512202:0:7021:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787892870.512206:0:7021:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:0.0:1787892870.512319:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455497856 00000100:00100000:0.0:1787892870.512329:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455497856 00000100:00100000:0.0:1787892870.512356:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455497984 00000100:00100000:0.0:1787892870.512360:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455497984 00000100:00100000:0.0:1787892870.512384:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787892870.512391:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874741455497856:12345-0@lo:400: 00000100:00100000:0.0:1787892870.512430:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874741455497856:12345-0@lo:400: Request processed in 40us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892870.512437:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787892870.512450:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787892870.512457:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874741455497984:12345-0@lo:400: 00000100:00100000:0.0:1787892870.512489:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874741455497984:12345-0@lo:400: Request processed in 33us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892870.512495:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000020:01000000:0.0:1787892870.512514:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1787892870.512533:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787892870.512544:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff90710153aa00/0x825e3f5022b4a52c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a533 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892870.512554:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff90710153aa00/0x825e3f5022b4a52c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a533 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787892870.512565:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787892870.512567:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff907105a88000 from 1 10000000:01000000:0.0:1787892870.512570:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787892870.512595:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff907100031e00/0x825e3f5022b4a54f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892870.512604:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff907100031e00/0x825e3f5022b4a54f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892870.512625:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff907100031e00/0x825e3f5022b4a54f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892870.512639:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455498112:0@lo:101: 00000100:00100000:0.0:1787892870.512667:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892870.512682:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff907107260780 going to sleep for 11 seconds 00000100:00100000:3.0:1787892870.512687:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455497600 00000100:00100000:3.0:1787892870.512691:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455497600 00000100:00080000:0.0:1787892870.512697:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787892870.512715:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787892870.512717:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90712e2f1c00 x1874741455497856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892870.512720:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105afb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1874741455497600:12345-0@lo:8: 00000100:00100000:0.0:1787892870.512727:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874741455497856:0@lo:400: 00010000:00080000:0.0:1787892870.512767:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90712e2f1f80 x1874741455497984/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892870.512777:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874741455497984:0@lo:400: 00000100:00100000:0.0:1787892870.512795:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455498112 00000100:00100000:0.0:1787892870.512799:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455498112 00000100:00100000:0.0:1787892870.512819:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787892870.512825:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907106341c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+15:5846:x1874741455498112:12345-0@lo:101: 00010000:00010000:0.0:1787892870.512834:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787892870.512846:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907100031000/0x825e3f5022b4a556 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4a54f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892870.512866:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907100031000/0x825e3f5022b4a556 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4a54f expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892870.512876:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907100031000/0x825e3f5022b4a556 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a54f expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892870.512897:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907100031000, rc 0) 00010000:00080000:3.0:1787892870.512912:0:6700:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 198 last 0 00000100:00100000:0.0:1787892870.512925:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907106341c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+16:5846:x1874741455498112:12345-0@lo:101: Request processed in 100us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892870.512930:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000020:00000080:3.0:1787892870.512953:0:6700:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x825e3f5022b4a55d 00000100:00100000:0.0:1787892870.512976:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455498112:0@lo:101: 00010000:00010000:0.0:1787892870.512988:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff907100031e00/0x825e3f5022b4a54f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a556 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1787892870.512991:0:6700:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff90712ebd6800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787892870.512995:0:6700:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00010000:00010000:0.0:1787892870.512997:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff907100031e00/0x825e3f5022b4a54f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a556 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:3.0:1787892870.513005:0:6700:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1787892870.513037:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455498240:0@lo:501: 00000100:00100000:0.0:1787892870.513061:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892870.513072:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff907107260780 going to sleep for 11 seconds 00000100:00100000:0.0:1787892870.513084:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455498240 00000100:00100000:0.0:1787892870.513088:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455498240 00000100:00100000:0.0:1787892870.513105:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787892870.513111:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907106342050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+16:5846:x1874741455498240:12345-0@lo:501: 00002000:00100000:3.0:1787892870.513125:0:6700:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787892870.513261:0:6700:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787892870.513287:0:6700:0:(import.c:65:import_set_state_nolock()) ffff90711b94f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787892870.513304:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907106342050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+16:5846:x1874741455498240:12345-0@lo:501: Request processed in 191us (241us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787892870.513311:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787892870.514454:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455498240:0@lo:501: 10000000:01000000:0.0:1787892870.514485:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787892870.514493:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff907100031e00/0x825e3f5022b4a54f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a556 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892870.514516:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff907100031e00/0x825e3f5022b4a54f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a556 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892870.514689:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105afb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1874741455497600:12345-0@lo:8: Request processed in 1967us (3369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892870.514699:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787892870.515871:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90712e2f2300 x1874741455497600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787892880 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892870.515887:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787892870.516336:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787892870.516348:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787892870.516356:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787892870.516360:0:3304:0:(import.c:65:import_set_state_nolock()) ffff907129bbe800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787892870.516429:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787892870.516437:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874741455497600:0@lo:8: 00000004:00080000:1.0:1787892870.516481:0:7026:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787892870.516642:0:7026:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 198283888885ns, next at 0ns, rc = 0 00000004:00080000:2.0:1787892870.571890:0:5870:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1787892870.617472:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000004:00080000:0.0:1787892870.617500:0:7027:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1787892870.617532:0:7027:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7027:1874741455498496:0@lo:7: 00000100:00100000:0.0:1787892870.617624:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892870.617681:0:7027:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071072600c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787892870.617711:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455498496 00000100:00100000:0.0:1787892870.617718:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455498496 00000100:00100000:0.0:1787892870.617800:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787892870.617812:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7027:x1874741455498496:12345-0@lo:7: 00000100:00100000:2.0:1787892870.621391:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455498368:0@lo:13: 00000100:00100000:2.0:1787892870.621482:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787892870.622373:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787892870.622669:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455498368 00000100:00100000:1.0:1787892870.622680:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455498368 00000100:00100000:1.0:1787892870.622791:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787892870.622803:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1874741455498368:12345-0@lo:13: 00002000:00000024:1.0:1787892870.622839:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1787892870.622919:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1874741455498368:12345-0@lo:13: Request processed in 118us (1435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892870.622927:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00002000:00080000:0.0:1787892870.623663:0:6702:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1787892870.623672:0:6702:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1787892870.623732:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7027:x1874741455498496:12345-0@lo:7: Request processed in 5920us (6105us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892870.623741:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787892870.623817:0:7027:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90712e2f1f80 x1874741455498496/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787892886 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892870.623832:0:7027:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7027:1874741455498496:0@lo:7: 00000004:00080000:0.0:1787892870.623846:0:7027:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1787892870.623887:0:7027:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7027:1874741455498624:0@lo:5: 00000100:00100000:0.0:1787892870.623918:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892870.623967:0:7027:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071072600c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787892870.623984:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455498624 00000100:00100000:0.0:1787892870.623988:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455498624 00000100:00100000:0.0:1787892870.624023:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787892870.624040:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7027:x1874741455498624:12345-0@lo:5: 00002000:00080000:0.0:1787892870.624067:0:6702:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1787892870.624071:0:6702:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1787892870.624274:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7027:x1874741455498624:12345-0@lo:5: Request processed in 236us (355us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787892870.624281:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787892870.624303:0:7027:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90712e2f1f80 x1874741455498624/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787892886 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892870.624314:0:7027:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7027:1874741455498624:0@lo:5: 00000004:00080000:0.0:1787892870.624322:0:7027:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00010000:00080000:1.0:1787892870.625021:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90712e2f3800 x1874741455498368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892886 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892870.625040:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455498368:0@lo:13: 00000001:02000400:0.0:1787892870.933366:0:7068:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg229-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787892871.241628:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787892872.265129:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787892873.289119:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892874.313407:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787892874.555442:0:6725:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1787892874.555460:0:6725:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1787892875.336954:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787892875.978173:0:7027:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7027:1874741455498880:0@lo:700: 00000100:00100000:0.0:1787892875.978248:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892875.978302:0:7027:0:(client.c:2715:ptlrpc_set_wait()) set ffff90711031b780 going to sleep for 11 seconds 00000100:00100000:0.0:1787892875.978342:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455498752:0@lo:13: 00000100:00100000:0.0:1787892875.978383:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892875.978510:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455498752 00000100:00100000:0.0:1787892875.978519:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455498752 00000100:00100000:0.0:1787892875.978584:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787892875.978595:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455498752:12345-0@lo:13: 00002000:00000024:0.0:1787892875.978632:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787892875.978679:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455498752:12345-0@lo:13: Request processed in 86us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892875.978704:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787892875.978729:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787892875.978782:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90712e2f3100 x1874741455498752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892891 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892875.978794:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787892875.978818:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455498752:0@lo:13: 00000100:00100000:1.0:1787892875.979661:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455498880 00000100:00100000:1.0:1787892875.979680:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455498880 00000100:00100000:1.0:1787892875.979714:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787892875.979721:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7027:x1874741455498880:12345-0@lo:700: 00000100:00100000:1.0:1787892875.979776:0:6708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907105af9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6708:1874741455499392:0@lo:700: 00000100:00100000:1.0:1787892875.979824:0:6708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892875.979844:0:6708:0:(client.c:2715:ptlrpc_set_wait()) set ffff907139e380c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787892875.979871:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907105afb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874741455499136:0@lo:400: 00000100:00100000:1.0:1787892875.979912:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892875.979932:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787892875.979938:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907105afb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874741455499264:0@lo:400: 00000100:00100000:1.0:1787892875.979957:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892875.980195:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455499392 00000100:00100000:0.0:1787892875.980201:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455499392 00000100:00100000:0.0:1787892875.980242:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787892875.980249:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105af9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6708:x1874741455499392:12345-0@lo:700: 00000100:00100000:0.0:1787892875.982742:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455499136 00000100:00100000:0.0:1787892875.982786:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455499136 00000100:00100000:0.0:1787892875.982831:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455499264 00000100:00100000:0.0:1787892875.982835:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455499264 00000100:00100000:0.0:1787892875.982866:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787892875.982875:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105af9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874741455499136:12345-0@lo:400: 00000100:00100000:0.0:1787892875.982982:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105af9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874741455499136:12345-0@lo:400: Request processed in 107us (3068us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892875.982989:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787892875.983007:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787892875.983014:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105af8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+6:3305:x1874741455499264:12345-0@lo:400: 00000100:00100000:0.0:1787892875.983043:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105af8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+6:3305:x1874741455499264:12345-0@lo:400: Request processed in 29us (3084us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892875.983049:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787892875.983087:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907105af8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22d910cf-711e-44e0-9acf-212404ada550:3308:1874741455499008:0@lo:400: 00000100:00100000:0.0:1787892875.983133:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892875.983191:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455499008 00000100:00100000:0.0:1787892875.983196:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455499008 00000100:00100000:0.0:1787892875.983219:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787892875.983225:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+16:3308:x1874741455499008:12345-0@lo:400: 00000100:00100000:0.0:1787892875.983258:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+16:3308:x1874741455499008:12345-0@lo:400: Request processed in 33us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892875.983264:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1787892875.983293:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787892875.983325:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff907105afb800 x1874741455499264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892875.983340:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907105afb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874741455499264:0@lo:400: 00010000:00080000:0.0:1787892875.983367:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff907105afb480 x1874741455499136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892875.983376:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907105afb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874741455499136:0@lo:400: 00000100:00100000:0.0:1787892875.983403:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907105af8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22d910cf-711e-44e0-9acf-212404ada550:3308:1874741455499008:0@lo:400: 40000000:02000000:2.0:1787892876.021225:0:5854:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1787892876.027568:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105af9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6708:x1874741455499392:12345-0@lo:700: Request processed in 47308us (47732us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892876.027604:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787892876.027784:0:6708:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff907105af9f80 x1874741455499392/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787892891 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892876.027801:0:6708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907105af9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6708:1874741455499392:0@lo:700: 40000000:02000000:0.0:1787892876.027815:0:6708:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:2.0:1787892876.067995:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7027:x1874741455498880:12345-0@lo:700: Request processed in 88264us (89736us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892876.068015:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787892876.068068:0:7027:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90712e2f3800 x1874741455498880/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787892891 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892876.068085:0:7027:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7027:1874741455498880:0@lo:700: 00000004:02000040:2.0:1787892876.104739:0:7027:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1787892876.109258:0:7027:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebc2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7027:1874741455499520:0@lo:5: 00000100:00100000:2.0:1787892876.109333:0:7027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892876.109405:0:7027:0:(client.c:2715:ptlrpc_set_wait()) set ffff907109145900 going to sleep for 11 seconds 00000100:00100000:3.0:1787892876.109574:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455499520 00000100:00100000:3.0:1787892876.109583:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455499520 00000100:00100000:3.0:1787892876.109647:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787892876.109659:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7027:x1874741455499520:12345-0@lo:5: 00002000:00080000:3.0:1787892876.120778:0:6702:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1787892876.120800:0:6702:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1787892876.123510:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7027:x1874741455499520:12345-0@lo:5: Request processed in 13841us (14164us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787892876.123527:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787892876.123593:0:7027:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90712ebc2300 x1874741455499520/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787892892 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892876.123611:0:7027:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebc2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7027:1874741455499520:0@lo:5: 00000004:00080000:3.0:1787892876.123629:0:7027:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00000001:00080000:0.0:1787892876.210929:0:6725:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1787892876.362111:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787892877.391957:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892878.410983:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787892879.436220:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892880.459579:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787892881.098238:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22d910cf-711e-44e0-9acf-212404ada550:3307:1874741455499648:0@lo:400: 00000100:00100000:2.0:1787892881.098329:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892881.099105:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787892881.099118:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874741455499776:0@lo:400: 00000100:00100000:2.0:1787892881.099155:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892881.099201:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874741455499904:0@lo:400: 00000100:00100000:2.0:1787892881.099224:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892881.099243:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787892881.099249:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455500032:0@lo:400: 00000100:00100000:2.0:1787892881.099271:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892881.102493:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787892881.102523:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907105afa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455500160:0@lo:13: 00000100:00100000:1.0:1787892881.102593:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892881.102786:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455500160 00000100:00100000:0.0:1787892881.102795:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455500160 00000100:00100000:0.0:1787892881.102872:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787892881.102882:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105af8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455500160:12345-0@lo:13: 00002000:00000024:0.0:1787892881.102922:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787892881.103155:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105af8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455500160:12345-0@lo:13: Request processed in 274us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892881.103163:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787892881.103188:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787892881.104586:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455499648 00000100:00100000:2.0:1787892881.104602:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455499648 00000100:00100000:2.0:1787892881.104629:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455499776 00000100:00100000:2.0:1787892881.104633:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455499776 00000100:00100000:2.0:1787892881.104860:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455499904 00000100:00100000:2.0:1787892881.104870:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455499904 00000100:00100000:2.0:1787892881.104991:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787892881.105002:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874741455499776:12345-0@lo:400: 00000100:00100000:2.0:1787892881.105082:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874741455499776:12345-0@lo:400: Request processed in 83us (5926us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892881.105088:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787892881.105104:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787892881.105110:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874741455499904:12345-0@lo:400: 00000100:00100000:2.0:1787892881.105146:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874741455499904:12345-0@lo:400: Request processed in 36us (5920us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892881.105152:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787892881.105181:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455500032 00000100:00100000:2.0:1787892881.105185:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455500032 00000100:00100000:2.0:1787892881.105210:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787892881.105216:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455500032:12345-0@lo:400: 00000100:00100000:2.0:1787892881.105246:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455500032:12345-0@lo:400: Request processed in 30us (5974us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892881.105251:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787892881.105598:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787892881.106624:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90712ebc3480 x1874741455500032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892881.106640:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787892881.106661:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455500032:0@lo:400: 00010000:00080000:2.0:1787892881.106730:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90712ebc0000 x1874741455499904/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892881.106741:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874741455499904:0@lo:400: 00010000:00080000:2.0:1787892881.106806:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90712ebc3100 x1874741455499776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892881.106825:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874741455499776:0@lo:400: 00010000:00080000:1.0:1787892881.113528:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff907105afa300 x1874741455500160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892897 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892881.113560:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907105afa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455500160:0@lo:13: 00000100:00100000:0.0:1787892881.128134:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787892881.128151:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+16:3307:x1874741455499648:12345-0@lo:400: 00000100:00100000:0.0:1787892881.128244:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+16:3307:x1874741455499648:12345-0@lo:400: Request processed in 97us (29916us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892881.128251:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787892881.128313:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22d910cf-711e-44e0-9acf-212404ada550:3307:1874741455499648:0@lo:400: 00010000:00010000:3.0:1787892881.486470:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787892882.441867:0:7638:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787892882.441873:0:7638:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1787892882.441998:0:7638:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9071072cc000 00000020:01000004:3.0:1787892882.442029:0:7638:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787892882.442045:0:7638:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1787892882.442075:0:7638:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff90712ea7b370) 00000020:00000080:3.0:1787892882.442095:0:7638:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787892882.461648:0:7638:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787892882.462055:0:7638:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787892882.502875:0:7638:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00010000:00010000:1.0:1787892882.506490:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1787892882.510337:0:7638:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787892882.510373:0:7638:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787892882.510434:0:7638:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787892882.510461:0:7638:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787892882.510855:0:7638:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787892882.510867:0:7638:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787892882.510879:0:7638:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x825e3f5022b4a56b 00000020:01000004:3.0:1787892882.510889:0:7638:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787892882.510910:0:7638:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.129@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787892882.510914:0:7638:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787892882.510920:0:7638:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787892882.510954:0:7638:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787892882.510959:0:7638:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.129@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787892882.566323:0:7638:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.129@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787892882.566372:0:7638:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.129@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1787892882.566378:0:7638:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787892882.566379:0:7638:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787892882.566381:0:7638:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787892882.566382:0:7638:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787892882.566384:0:7638:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787892882.566385:0:7638:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787892882.566387:0:7638:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787892882.566389:0:7638:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787892882.566391:0:7638:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787892882.566394:0:7638:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787892882.566395:0:7638:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787892882.566401:0:7638:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1787892882.566403:0:7638:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787892882.566404:0:7638:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787892882.566406:0:7638:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787892882.566406:0:7638:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787892882.566408:0:7638:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787892882.566409:0:7638:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787892882.566410:0:7638:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787892882.566411:0:7638:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787892882.566412:0:7638:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787892882.566413:0:7638:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787892882.566414:0:7638:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787892882.566447:0:7638:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787892882.566469:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebc3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:7638:1874741455500288:0@lo:253: 00000100:00100000:2.0:1787892882.566550:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892882.566672:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff90713f588000 going to sleep for 11 seconds 00000100:00100000:0.0:1787892882.571088:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455500288 00000100:00100000:0.0:1787892882.571106:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455500288 00000100:00100000:1.0:1787892882.576315:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787892882.576340:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+16:7638:x1874741455500288:12345-0@lo:253: 20000000:01000000:1.0:1787892882.576428:0:5841:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787892882.576434:0:5841:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1787892882.576443:0:5841:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1787892882.576448:0:5841:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1787892882.584587:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787892882.585169:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1787892882.585186:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1787892882.585230:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1787892882.585238:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1787892882.585269:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1787892882.585319:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1787892882.585710:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1787892882.592072:0:5841:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.129@tcp 20000000:01000000:1.0:1787892882.592090:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.129@tcp (null) (null) (null) 00000040:00080000:1.0:1787892882.592257:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1787892882.592275:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787892882.592360:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1787892882.592369:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.129@tcp (null) (null) 00000040:00080000:1.0:1787892882.592404:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1787892882.592414:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787892882.592445:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1787892882.592499:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1787892882.593562:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1787892882.593588:0:5841:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.129@tcp 20000000:01000000:1.0:1787892882.593590:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.129@tcp (null) (null) (null) 00000040:00080000:1.0:1787892882.593626:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1787892882.593634:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787892882.593664:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1787892882.593671:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.129@tcp (null) (null) 00000040:00080000:1.0:1787892882.593698:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1787892882.593706:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787892882.597339:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1787892882.597442:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1787892882.597465:0:5841:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787892882.597469:0:5841:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787892882.597488:0:5841:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787892882.597501:0:5841:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787892882.597504:0:5841:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787892882.597546:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787892882.597549:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787892882.601291:0:7640:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1787892882.601436:0:7640:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1787892882.601473:0:7640:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1787892882.601930:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1787892882.601975:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1787892882.602032:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1787892882.602045:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787892882.602047:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787892882.602997:0:7641:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1787892882.603055:0:7641:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1787892882.603126:0:7641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1787892882.603531:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1787892882.603574:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1787892882.603610:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1787892882.603622:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1787892882.603625:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787892882.607591:0:7642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1787892882.609635:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1787892882.609691:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1787892882.613234:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1787892882.613280:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787892882.613283:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787892882.614565:0:7643:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1787892882.614650:0:7643:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1787892882.614706:0:7643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1787892882.616842:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1787892882.616892:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1787892882.616954:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1787892882.616984:0:5841:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1787892882.616987:0:5841:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1787892882.616996:0:5841:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787892882.617014:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9071013fca00/0x825e3f5022b4a572 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.617033:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907100030c00/0x825e3f5022b4a4c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a4bc expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.617041:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9071421fa000/0x825e3f5022b4a4ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a4e6 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.617048:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9071421fa800/0x825e3f5022b4a517 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a510 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.617054:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9071421fae00/0x825e3f5022b4a533 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a52c expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.617061:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907100031000/0x825e3f5022b4a556 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a54f expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.617067:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9071013fca00/0x825e3f5022b4a572 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.617103:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907100031000/0x825e3f5022b4a556 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x825e3f5022b4a54f expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.617118:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907100031000/0x825e3f5022b4a556 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x825e3f5022b4a54f expref: 16 pid: 5843 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892882.617131:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebc0000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1874741455500416:0@lo:104: 00000100:00100000:2.0:1787892882.617191:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787892882.617245:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9071421fae00/0x825e3f5022b4a533 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x825e3f5022b4a52c expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.617254:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9071421fae00/0x825e3f5022b4a533 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x825e3f5022b4a52c expref: 16 pid: 5841 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892882.617262:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebc3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1874741455500544:0@lo:104: 00010000:00010000:2.0:1787892882.617281:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9071421fa800/0x825e3f5022b4a517 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x825e3f5022b4a510 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.617288:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9071421fa800/0x825e3f5022b4a517 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x825e3f5022b4a510 expref: 16 pid: 5842 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892882.617295:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebc2300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1874741455500672:0@lo:104: 00010000:00010000:2.0:1787892882.617310:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9071421fa000/0x825e3f5022b4a4ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x825e3f5022b4a4e6 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.617328:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9071421fa000/0x825e3f5022b4a4ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x825e3f5022b4a4e6 expref: 16 pid: 5842 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892882.617335:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebc1c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1874741455500800:0@lo:104: 00010000:00010000:2.0:1787892882.617355:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907100030c00/0x825e3f5022b4a4c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x825e3f5022b4a4bc expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.617363:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907100030c00/0x825e3f5022b4a4c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x825e3f5022b4a4bc expref: 16 pid: 5841 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892882.617370:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebc3800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1874741455500928:0@lo:104: 00000100:00100000:2.0:1787892882.617400:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff90713f588d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787892882.617668:0:5832:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787892882.617687:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892882.617765:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892882.620288:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892882.624767:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455500416 00000100:00100000:2.0:1787892882.624813:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455500416 00000100:00100000:2.0:1787892882.624897:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455500544 00000100:00100000:2.0:1787892882.624902:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455500544 00000100:00100000:2.0:1787892882.624915:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455500672 00000100:00100000:2.0:1787892882.624918:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455500672 00000100:00100000:2.0:1787892882.625160:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787892882.625176:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907110277450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22d910cf-711e-44e0-9acf-212404ada550+5:5841:x1874741455500416:12345-0@lo:104: 00010000:00010000:2.0:1787892882.625195:0:5831:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff907100031e00/0x825e3f5022b4a54f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a556 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.625311:0:5831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787892882.625438:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebc0000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1874741455500416:0@lo:104: 00000100:00100000:2.0:1787892882.626472:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907110277450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22d910cf-711e-44e0-9acf-212404ada550+5:5841:x1874741455500416:12345-0@lo:104: Request processed in 147us (8126us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892882.626484:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787892882.626542:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787892882.626553:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22d910cf-711e-44e0-9acf-212404ada550+4:5841:x1874741455500544:12345-0@lo:104: 00010000:00010000:2.0:1787892882.626569:0:5831:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff90710153aa00/0x825e3f5022b4a52c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a533 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.626642:0:5831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787892882.626648:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22d910cf-711e-44e0-9acf-212404ada550+4:5841:x1874741455500544:12345-0@lo:104: Request processed in 99us (8960us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892882.626654:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787892882.626666:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787892882.626673:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22d910cf-711e-44e0-9acf-212404ada550+3:5841:x1874741455500672:12345-0@lo:104: 00010000:00010000:2.0:1787892882.626680:0:5831:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9071013fc800/0x825e3f5022b4a510 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a517 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.626708:0:5831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787892882.626726:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22d910cf-711e-44e0-9acf-212404ada550+3:5841:x1874741455500672:12345-0@lo:104: Request processed in 54us (8973us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892882.627202:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1787892882.627224:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787892882.627230:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff907100031e00/0x825e3f5022b4a54f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a556 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.627238:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907100031e00 already unused, calling callback (ffffffffc1c05c20) 10000000:00010000:2.0:1787892882.627242:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff907100031e00/0x825e3f5022b4a54f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x825e3f5022b4a556 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.627251:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff907100031e00/0x825e3f5022b4a54f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x825e3f5022b4a556 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787892882.627258:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff907100031e00/0x825e3f5022b4a54f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x825e3f5022b4a556 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892882.627263:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787892882.627297:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff907100031e00/0x825e3f5022b4a54f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a556 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.627303:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787892882.627409:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22d910cf-711e-44e0-9acf-212404ada550:3308:1874741455501056:0@lo:103: 00000100:00100000:3.0:1787892882.627450:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787892882.627551:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff907100031e00/0x825e3f5022b4a54f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a556 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.627560:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff907100031e00/0x825e3f5022b4a54f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a556 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.627572:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787892882.627575:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff90710153aa00/0x825e3f5022b4a52c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a533 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.627593:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153aa00 already unused, calling callback (ffffffffc1c05c20) 10000000:00010000:2.0:1787892882.627597:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff90710153aa00/0x825e3f5022b4a52c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x825e3f5022b4a533 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.627603:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff90710153aa00/0x825e3f5022b4a52c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x825e3f5022b4a533 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787892882.627610:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff90710153aa00/0x825e3f5022b4a52c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x825e3f5022b4a533 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892882.627615:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787892882.627633:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff90710153aa00/0x825e3f5022b4a52c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a533 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.627640:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787892882.627652:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff90710153aa00/0x825e3f5022b4a52c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a533 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.627659:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff90710153aa00/0x825e3f5022b4a52c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a533 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.627669:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787892882.627672:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9071013fc800/0x825e3f5022b4a510 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a517 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.627678:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071013fc800 already unused, calling callback (ffffffffc1c05c20) 10000000:00010000:2.0:1787892882.627681:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9071013fc800/0x825e3f5022b4a510 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x825e3f5022b4a517 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.627697:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9071013fc800/0x825e3f5022b4a510 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x825e3f5022b4a517 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787892882.627704:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9071013fc800/0x825e3f5022b4a510 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x825e3f5022b4a517 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892882.627710:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787892882.627725:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9071013fc800/0x825e3f5022b4a510 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a517 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.627815:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787892882.627830:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9071013fc800/0x825e3f5022b4a510 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a517 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.627837:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9071013fc800/0x825e3f5022b4a510 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a517 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.627846:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892882.627847:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892882.627849:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787892882.627859:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455501184:0@lo:103: 00000100:00100000:2.0:1787892882.627901:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892882.627928:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787892882.627933:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455501312:0@lo:103: 00000100:00100000:2.0:1787892882.627954:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892882.627985:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455501056 00000100:00100000:2.0:1787892882.627992:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455501056 00010000:00010000:2.0:1787892882.628015:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907100031000/0x825e3f5022b4a556 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a54f expref: 17 pid: 5843 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892882.628041:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455501184 00000100:00100000:2.0:1787892882.628044:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455501184 00010000:00010000:2.0:1787892882.628055:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9071421fae00/0x825e3f5022b4a533 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a52c expref: 18 pid: 5841 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892882.628063:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455501312 00000100:00100000:2.0:1787892882.628065:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455501312 00010000:00010000:2.0:1787892882.628074:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9071421fa800/0x825e3f5022b4a517 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a510 expref: 19 pid: 5842 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892882.628084:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787892882.628091:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebbf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22d910cf-711e-44e0-9acf-212404ada550+19:3308:x1874741455501056:12345-0@lo:103: 00010000:00010000:2.0:1787892882.628103:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787892882.628108:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907100031000/0x825e3f5022b4a556 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a54f expref: 19 pid: 5843 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.628118:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907100031000/0x825e3f5022b4a556 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x825e3f5022b4a54f expref: 19 pid: 5843 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.628131:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907100031000/0x825e3f5022b4a556 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x825e3f5022b4a54f expref: 19 pid: 5843 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.628143:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787892882.628285:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892882.628295:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455500800 00000100:00100000:0.0:1787892882.628299:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455500800 00000100:00100000:0.0:1787892882.628330:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455500928 00000100:00100000:0.0:1787892882.628333:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455500928 00000100:00100000:0.0:1787892882.628346:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787892882.628352:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22d910cf-711e-44e0-9acf-212404ada550+4:5841:x1874741455500800:12345-0@lo:104: 00010000:00010000:0.0:1787892882.628367:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff90710153b000/0x825e3f5022b4a4e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a4ed expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892882.628405:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787892882.628410:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22d910cf-711e-44e0-9acf-212404ada550+4:5841:x1874741455500800:12345-0@lo:104: Request processed in 60us (8131us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892882.628417:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787892882.628431:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787892882.628437:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22d910cf-711e-44e0-9acf-212404ada550+3:5841:x1874741455500928:12345-0@lo:104: 00010000:00010000:0.0:1787892882.628444:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff90710153a200/0x825e3f5022b4a4bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a4c3 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892882.628469:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787892882.628474:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22d910cf-711e-44e0-9acf-212404ada550+3:5841:x1874741455500928:12345-0@lo:104: Request processed in 38us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892882.628480:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1787892882.628494:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787892882.628497:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff90710153b000/0x825e3f5022b4a4e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a4ed expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892882.628519:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153b000 already unused, calling callback (ffffffffc1c05c20) 10000000:00010000:0.0:1787892882.628522:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff90710153b000/0x825e3f5022b4a4e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x825e3f5022b4a4ed expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892882.628530:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff90710153b000/0x825e3f5022b4a4e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x825e3f5022b4a4ed expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787892882.628536:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff90710153b000/0x825e3f5022b4a4e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x825e3f5022b4a4ed expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787892882.628549:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787892882.628568:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff90710153b000/0x825e3f5022b4a4e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a4ed expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892882.628574:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787892882.631116:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebbf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22d910cf-711e-44e0-9acf-212404ada550+18:3308:x1874741455501056:12345-0@lo:103: Request processed in 3015us (3655us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892882.631131:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787892882.631167:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787892882.631180:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107e83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22d910cf-711e-44e0-9acf-212404ada550+17:3305:x1874741455501184:12345-0@lo:103: 00010000:00010000:2.0:1787892882.631223:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787892882.631234:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9071421fae00/0x825e3f5022b4a533 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a52c expref: 17 pid: 5841 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.631251:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9071421fae00/0x825e3f5022b4a533 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x825e3f5022b4a52c expref: 17 pid: 5841 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.631275:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787892882.631457:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107e83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22d910cf-711e-44e0-9acf-212404ada550+17:3305:x1874741455501184:12345-0@lo:103: Request processed in 282us (3554us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892882.631463:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787892882.631476:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787892882.631483:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107e83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22d910cf-711e-44e0-9acf-212404ada550+16:3305:x1874741455501312:12345-0@lo:103: 00010000:00010000:2.0:1787892882.631491:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787892882.631496:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9071421fa800/0x825e3f5022b4a517 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a510 expref: 16 pid: 5842 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.631504:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9071421fa800/0x825e3f5022b4a517 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x825e3f5022b4a510 expref: 16 pid: 5842 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.631514:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787892882.631538:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107e83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22d910cf-711e-44e0-9acf-212404ada550+16:3305:x1874741455501312:12345-0@lo:103: Request processed in 56us (3582us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892882.631543:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1787892882.631576:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787892882.631904:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9071421fae00/0x825e3f5022b4a533 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x825e3f5022b4a52c expref: 15 pid: 5841 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892882.631920:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebc3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1874741455500544:0@lo:104: 00010000:00010000:2.0:1787892882.631941:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9071421fa800/0x825e3f5022b4a517 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x825e3f5022b4a510 expref: 14 pid: 5842 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892882.631951:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebc2300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1874741455500672:0@lo:104: 00000100:00100000:2.0:1787892882.631961:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebc1c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1874741455500800:0@lo:104: 00000100:00100000:2.0:1787892882.631970:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebc3800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1874741455500928:0@lo:104: 00010000:00010000:2.0:1787892882.632157:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9071013fca00/0x825e3f5022b4a572 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.632250:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892882.632258:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff90710153a200/0x825e3f5022b4a4bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a4c3 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.632266:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153a200 already unused, calling callback (ffffffffc1c05c20) 10000000:00010000:2.0:1787892882.632270:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff90710153a200/0x825e3f5022b4a4bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x825e3f5022b4a4c3 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.632278:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff90710153a200/0x825e3f5022b4a4bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x825e3f5022b4a4c3 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787892882.632286:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff90710153a200/0x825e3f5022b4a4bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x825e3f5022b4a4c3 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892882.632292:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787892882.632395:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff90710153a200/0x825e3f5022b4a4bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a4c3 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.632402:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787892882.632414:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff90710153a200/0x825e3f5022b4a4bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a4c3 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.632433:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff90710153a200/0x825e3f5022b4a4bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a4c3 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.632447:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892882.632449:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892882.632451:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892882.632463:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892882.632464:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787892882.632542:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22d910cf-711e-44e0-9acf-212404ada550:3308:1874741455501056:0@lo:103: 00000100:00100000:3.0:1787892882.632568:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22d910cf-711e-44e0-9acf-212404ada550:3308:1874741455501568:0@lo:103: 00000100:00100000:3.0:1787892882.632610:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892882.632649:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787892882.632655:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22d910cf-711e-44e0-9acf-212404ada550:3308:1874741455501440:0@lo:103: 00000100:00100000:3.0:1787892882.632676:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892882.632706:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455501568 00000100:00100000:3.0:1787892882.632711:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455501568 00010000:00010000:3.0:1787892882.632744:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907100030c00/0x825e3f5022b4a4c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a4bc expref: 14 pid: 5841 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892882.632777:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455501440 00000100:00100000:3.0:1787892882.632781:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455501440 00010000:00010000:3.0:1787892882.632792:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9071421fa000/0x825e3f5022b4a4ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a4e6 expref: 15 pid: 5842 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892882.632806:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787892882.632812:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebbf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22d910cf-711e-44e0-9acf-212404ada550+15:3308:x1874741455501568:12345-0@lo:103: 00010000:00010000:3.0:1787892882.632829:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787892882.632835:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907100030c00/0x825e3f5022b4a4c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a4bc expref: 15 pid: 5841 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892882.632843:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907100030c00/0x825e3f5022b4a4c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x825e3f5022b4a4bc expref: 15 pid: 5841 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892882.632855:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907100030c00/0x825e3f5022b4a4c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x825e3f5022b4a4bc expref: 15 pid: 5841 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892882.632866:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787892882.632896:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebbf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22d910cf-711e-44e0-9acf-212404ada550+14:3308:x1874741455501568:12345-0@lo:103: Request processed in 84us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892882.632908:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787892882.632923:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787892882.632928:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22d910cf-711e-44e0-9acf-212404ada550+13:3308:x1874741455501440:12345-0@lo:103: 00010000:00010000:3.0:1787892882.632935:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787892882.632940:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9071421fa000/0x825e3f5022b4a4ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a4e6 expref: 13 pid: 5842 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892882.632949:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9071421fa000/0x825e3f5022b4a4ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x825e3f5022b4a4e6 expref: 13 pid: 5842 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892882.633988:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9071421fa000/0x825e3f5022b4a4ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x825e3f5022b4a4e6 expref: 13 pid: 5842 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892882.634011:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9071013fca00/0x825e3f5022b4a572 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892882.634020:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9071013fca00/0x825e3f5022b4a572 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892882.634037:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9071013fca00/0x825e3f5022b4a572 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892882.634044:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9071013fca00/0x825e3f5022b4a572 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892882.634050:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9071013fca00/0x825e3f5022b4a572 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892882.634057:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9071013fca00/0x825e3f5022b4a572 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892882.634078:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071013fca00 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:3.0:1787892882.634082:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9071013fca00/0x825e3f5022b4a572 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892882.634089:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9071013fca00/0x825e3f5022b4a572 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892882.634109:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9071013fca00/0x825e3f5022b4a572 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892882.634120:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787892882.634162:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22d910cf-711e-44e0-9acf-212404ada550+12:3308:x1874741455501440:12345-0@lo:103: Request processed in 1233us (1484us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892882.634169:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1787892882.634204:0:5841:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9071013fca00/0x825e3f5022b4a572 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892882.634212:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9071013fca00/0x825e3f5022b4a572 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892882.634217:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9071013fca00/0x825e3f5022b4a572 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787892882.634231:0:5841:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787892882.634887:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22d910cf-711e-44e0-9acf-212404ada550:3308:1874741455501440:0@lo:103: 00000100:00100000:2.0:1787892882.634903:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22d910cf-711e-44e0-9acf-212404ada550:3308:1874741455501568:0@lo:103: 00010000:00010000:0.0:1787892882.634992:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff90710153b000/0x825e3f5022b4a4e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a4ed expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892882.635000:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff90710153b000/0x825e3f5022b4a4e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a4ed expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892882.635017:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787892882.635019:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787892882.635022:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787892882.640158:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455501184:0@lo:103: 00000100:00100000:1.0:1787892882.640197:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455501312:0@lo:103: 00000100:00100000:2.0:1787892882.737326:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+11:7638:x1874741455500288:12345-0@lo:253: Request processed in 160982us (170765us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892882.737341:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787892882.737459:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebc3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:7638:1874741455500288:0@lo:253: 10000000:01000000:3.0:1787892882.737479:0:7638:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787892882.737483:0:7638:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787892882.737484:0:7638:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787892882.737486:0:7638:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787892882.737502:0:7638:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1787892882.737504:0:7638:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787892882.737505:0:7638:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787892882.737506:0:7638:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787892882.737508:0:7638:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787892882.737510:0:7638:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787892882.737511:0:7638:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787892882.737530:0:7638:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9071072cc000 from lustre-OST0001 10000000:01000000:3.0:1787892882.737555:0:7638:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787892882.737558:0:7638:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787892882.737567:0:7638:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff907105a88000 local copy 10000000:01000000:3.0:1787892882.737571:0:7638:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787892882.737607:0:7638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff90710153ac00/0x825e3f5022b4a579 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892882.737619:0:7638:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.129@tcp lock: ffff90710153ac00/0x825e3f5022b4a579 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892882.737628:0:7638:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff90710153ac00/0x825e3f5022b4a579 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892882.737645:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:7638:1874741455501696:0@lo:101: 00000100:00100000:3.0:1787892882.737682:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892882.737740:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071103b70c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787892882.737893:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455501696 00000100:00100000:2.0:1787892882.737900:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455501696 00000100:00100000:2.0:1787892882.737943:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787892882.737951:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+11:7638:x1874741455501696:12345-0@lo:101: 00010000:00010000:2.0:1787892882.737962:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787892882.737975:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9071013fc800/0x825e3f5022b4a580 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4a579 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.737997:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9071013fc800/0x825e3f5022b4a580 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4a579 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.738007:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9071013fc800/0x825e3f5022b4a580 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a579 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.738028:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071013fc800, rc 0) 00000100:00100000:2.0:1787892882.738056:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+12:7638:x1874741455501696:12345-0@lo:101: Request processed in 106us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892882.738062:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787892882.738131:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:7638:1874741455501696:0@lo:101: 00010000:00010000:3.0:1787892882.738142:0:7638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff90710153ac00/0x825e3f5022b4a579 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x825e3f5022b4a580 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892882.738150:0:7638:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff90710153ac00/0x825e3f5022b4a579 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x825e3f5022b4a580 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892882.738241:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:7638:1874741455501824:0@lo:501: 00000100:00100000:3.0:1787892882.738274:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892882.738300:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071103b70c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787892882.738399:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455501824 00000100:00100000:2.0:1787892882.738403:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455501824 00000100:00100000:2.0:1787892882.738432:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787892882.738439:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+12:7638:x1874741455501824:12345-0@lo:501: 00000100:00100000:2.0:1787892882.738646:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+12:7638:x1874741455501824:12345-0@lo:501: Request processed in 207us (370us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787892882.738653:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787892882.738727:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:7638:1874741455501824:0@lo:501: 10000000:01000000:0.0:1787892882.738740:0:7638:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787892882.738812:0:7638:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787892882.738818:0:7638:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff90710153ac00/0x825e3f5022b4a579 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x825e3f5022b4a580 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892882.738834:0:7638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff90710153ac00/0x825e3f5022b4a579 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x825e3f5022b4a580 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892882.738842:0:7638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.129@tcp lock: ffff90710153ac00/0x825e3f5022b4a579 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x825e3f5022b4a580 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892882.738863:0:7638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787892882.738882:0:7638:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9071072cc000 10000000:01000000:0.0:1787892882.738892:0:7638:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787892882.738898:0:7638:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787892882.738900:0:7638:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787892882.738904:0:7638:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1787892882.738907:0:7638:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787892882.738925:0:7638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff907100031000/0x825e3f5022b4a587 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892882.738933:0:7638:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff907100031000/0x825e3f5022b4a587 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892882.738941:0:7638:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff907100031000/0x825e3f5022b4a587 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892882.738953:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:7638:1874741455501952:0@lo:101: 00000100:00100000:0.0:1787892882.738983:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892882.739011:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff907109145180 going to sleep for 11 seconds 00000100:00100000:3.0:1787892882.739130:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455501952 00000100:00100000:3.0:1787892882.739136:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455501952 00000100:00100000:3.0:1787892882.739168:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787892882.739175:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+12:7638:x1874741455501952:12345-0@lo:101: 00010000:00010000:3.0:1787892882.739183:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787892882.739193:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90710153b200/0x825e3f5022b4a58e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4a587 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892882.739208:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90710153b200/0x825e3f5022b4a58e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4a587 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892882.739219:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90710153b200/0x825e3f5022b4a58e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a587 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892882.739226:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90710153b200, rc 0) 00000100:00100000:3.0:1787892882.739254:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+13:7638:x1874741455501952:12345-0@lo:101: Request processed in 79us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892882.739260:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00010000:2.0:1787892882.739320:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787892882.739325:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff90710153ac00/0x825e3f5022b4a579 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x825e3f5022b4a580 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.739333:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153ac00 already unused, calling callback (ffffffffc1c05c20) 10000000:00010000:2.0:1787892882.739337:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff90710153ac00/0x825e3f5022b4a579 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x825e3f5022b4a580 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.739345:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff90710153ac00/0x825e3f5022b4a579 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x825e3f5022b4a580 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787892882.739352:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff90710153ac00/0x825e3f5022b4a579 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x825e3f5022b4a580 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892882.739357:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787892882.739375:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff90710153ac00/0x825e3f5022b4a579 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x825e3f5022b4a580 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.739391:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787892882.739415:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff90710153ac00/0x825e3f5022b4a579 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x825e3f5022b4a580 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.739423:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff90710153ac00/0x825e3f5022b4a579 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x825e3f5022b4a580 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892882.739439:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892882.739441:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892882.739442:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787892882.739450:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787892882.739462:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22d910cf-711e-44e0-9acf-212404ada550:3306:1874741455502080:0@lo:103: 00000100:00100000:2.0:1787892882.739492:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892882.739576:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:7638:1874741455501952:0@lo:101: 00010000:00010000:0.0:1787892882.739589:0:7638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff907100031000/0x825e3f5022b4a587 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a58e expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892882.739598:0:7638:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff907100031000/0x825e3f5022b4a587 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a58e expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892882.739658:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455502080 00000100:00100000:0.0:1787892882.739662:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:7638:1874741455502208:0@lo:501: 00000100:00100000:1.0:1787892882.739665:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455502080 00000100:00100000:0.0:1787892882.739699:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892882.739712:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff907109145180 going to sleep for 11 seconds 00000100:00100000:1.0:1787892882.739723:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787892882.739733:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107e82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22d910cf-711e-44e0-9acf-212404ada550+13:3306:x1874741455502080:12345-0@lo:103: 00010000:00010000:1.0:1787892882.739744:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787892882.739778:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9071013fc800/0x825e3f5022b4a580 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x825e3f5022b4a579 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892882.739790:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787892882.739837:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107e82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22d910cf-711e-44e0-9acf-212404ada550+12:3306:x1874741455502080:12345-0@lo:103: Request processed in 106us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892882.739853:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787892882.740716:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455502208 00000100:00100000:3.0:1787892882.740725:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455502208 00000100:00100000:3.0:1787892882.740888:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787892882.740899:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+12:7638:x1874741455502208:12345-0@lo:501: 00000100:00100000:3.0:1787892882.741167:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+12:7638:x1874741455502208:12345-0@lo:501: Request processed in 270us (1467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892882.741174:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787892882.741274:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22d910cf-711e-44e0-9acf-212404ada550:3306:1874741455502080:0@lo:103: 00000100:00100000:1.0:1787892882.741843:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:7638:1874741455502208:0@lo:501: 00000100:00100000:1.0:1787892882.741889:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907105afa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:7638:1874741455502336:0@lo:503: 00000100:00100000:1.0:1787892882.741941:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892882.741967:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff90712c4cc540 going to sleep for 11 seconds 00000100:00100000:0.0:1787892882.745176:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455502336 00000100:00100000:0.0:1787892882.745211:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455502336 00000100:00100000:0.0:1787892882.745285:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787892882.745296:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+12:7638:x1874741455502336:12345-0@lo:503: 00000100:00100000:0.0:1787892882.745592:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+12:7638:x1874741455502336:12345-0@lo:503: Request processed in 297us (3650us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892882.745601:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787892882.745875:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907105afa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:7638:1874741455502336:0@lo:503: 00000040:00080000:3.0:1787892882.746373:0:7638:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787892882.746459:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:7638:1874741455502464:0@lo:502: 00000100:00100000:3.0:1787892882.746516:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892882.746610:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071103b7540 going to sleep for 11 seconds 00000100:00100000:0.0:1787892882.755360:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455502464 00000100:00100000:0.0:1787892882.755376:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455502464 00000100:00100000:1.0:1787892882.756526:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787892882.756540:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+12:7638:x1874741455502464:12345-0@lo:502: 00000100:00100000:1.0:1787892882.758963:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+12:7638:x1874741455502464:12345-0@lo:502: Request processed in 2407us (12427us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892882.758986:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787892882.761990:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:7638:1874741455502464:0@lo:502: 00000040:00080000:3.0:1787892882.762347:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787892882.762438:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787892882.762494:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787892882.762537:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787892882.762568:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787892882.762608:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787892882.762655:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:7638:1874741455502592:0@lo:502: 00000100:00100000:3.0:1787892882.762734:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892882.762807:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071103b7540 going to sleep for 11 seconds 00000100:00100000:1.0:1787892882.762808:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455502592 00000100:00100000:1.0:1787892882.762815:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455502592 00000100:00100000:1.0:1787892882.762872:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787892882.762883:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+12:7638:x1874741455502592:12345-0@lo:502: 00000100:00100000:1.0:1787892882.763093:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+12:7638:x1874741455502592:12345-0@lo:502: Request processed in 212us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892882.763102:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787892882.763314:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:7638:1874741455502592:0@lo:502: 00000040:00080000:3.0:1787892882.763414:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787892882.763425:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1787892882.768667:0:7647:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787892882.768681:0:7647:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1787892882.768689:0:7647:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787892882.768691:0:7647:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787892882.768697:0:7647:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787892882.768726:0:7647:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff90712ea78000) 00000020:00000080:3.0:1787892882.768772:0:7647:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787892882.768779:0:7647:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787892882.768883:0:7647:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9071072cc000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787892882.768892:0:7647:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787892882.768900:0:7647:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x825e3f5022b4a59c 00010000:00010000:2.0:1787892882.776577:0:7647:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1787892882.777320:0:7647:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1787892882.781163:0:7647:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1787892882.781473:0:7647:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1787892882.787516:0:7647:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1787892882.788095:0:7647:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1787892882.797612:0:7647:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787892882.797627:0:7647:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787892882.797636:0:7647:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787892882.797639:0:7647:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787892882.797643:0:7647:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787892882.797648:0:7647:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787892882.797649:0:7647:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787892882.797652:0:7647:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787892882.797654:0:7647:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787892882.797735:0:7647:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787892882.797739:0:7647:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787892882.797741:0:7647:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787892882.797744:0:7647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1787892882.798167:0:7638:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1787892882.798214:0:7638:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787892882.798241:0:7638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff907100031000/0x825e3f5022b4a587 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a58e expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892882.798273:0:7638:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff907100031000/0x825e3f5022b4a587 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a58e expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787892882.798282:0:7638:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9071072cc000 from 1 10000000:01000000:3.0:1787892882.798285:0:7638:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787892882.798331:0:7638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff90710153b600/0x825e3f5022b4a5a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892882.798340:0:7638:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff90710153b600/0x825e3f5022b4a5a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892882.798354:0:7638:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff90710153b600/0x825e3f5022b4a5a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892882.798383:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:7638:1874741455502720:0@lo:101: 00000100:00100000:3.0:1787892882.798473:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892882.798545:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455502720 00000100:00100000:0.0:1787892882.798558:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455502720 00000100:00100000:3.0:1787892882.798594:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071103b7840 going to sleep for 11 seconds 00000100:00100000:0.0:1787892882.799532:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787892882.799549:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+12:7638:x1874741455502720:12345-0@lo:101: 00010000:00010000:0.0:1787892882.799567:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787892882.799711:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907100030c00/0x825e3f5022b4a5aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4a5a3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892882.800216:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907100030c00/0x825e3f5022b4a5aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4a5a3 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892882.800246:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907100030c00/0x825e3f5022b4a5aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a5a3 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892882.800256:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907100030c00, rc 0) 00000100:00100000:0.0:1787892882.800339:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+13:7638:x1874741455502720:12345-0@lo:101: Request processed in 793us (1865us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892882.800348:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787892882.800390:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:7638:1874741455502720:0@lo:101: 00010000:00010000:3.0:1787892882.800408:0:7638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff90710153b600/0x825e3f5022b4a5a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a5aa expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892882.800420:0:7638:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff90710153b600/0x825e3f5022b4a5a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a5aa expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892882.800521:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:7638:1874741455502848:0@lo:501: 00000100:00100000:3.0:1787892882.800554:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892882.800592:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071103b7840 going to sleep for 11 seconds 00000100:00100000:2.0:1787892882.800651:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455502848 00000100:00100000:2.0:1787892882.800659:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455502848 00000100:00100000:2.0:1787892882.800701:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787892882.800708:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+13:7638:x1874741455502848:12345-0@lo:501: 00000100:00100000:2.0:1787892882.800990:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+13:7638:x1874741455502848:12345-0@lo:501: Request processed in 282us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892882.800997:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787892882.801266:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:7638:1874741455502848:0@lo:501: 00000100:00100000:3.0:1787892882.801292:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:7638:1874741455502976:0@lo:503: 00000100:00100000:3.0:1787892882.801342:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892882.801360:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071103b7840 going to sleep for 11 seconds 00000100:00100000:0.0:1787892882.802185:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455502976 00000100:00100000:0.0:1787892882.802193:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455502976 00000100:00100000:0.0:1787892882.802236:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787892882.802244:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+13:7638:x1874741455502976:12345-0@lo:503: 00000100:00100000:0.0:1787892882.805064:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+13:7638:x1874741455502976:12345-0@lo:503: Request processed in 2809us (3709us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892882.805084:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787892882.807897:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:7638:1874741455502976:0@lo:503: 00000040:00080000:3.0:1787892882.808300:0:7638:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787892882.808407:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:7638:1874741455503104:0@lo:502: 00000100:00100000:3.0:1787892882.810716:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892882.810893:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071103b7840 going to sleep for 11 seconds 00000100:00100000:0.0:1787892882.812472:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455503104 00000100:00100000:0.0:1787892882.812487:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455503104 00000100:00100000:0.0:1787892882.812588:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787892882.812600:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+13:7638:x1874741455503104:12345-0@lo:502: 00000100:00100000:0.0:1787892882.812958:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+13:7638:x1874741455503104:12345-0@lo:502: Request processed in 360us (2247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892882.812966:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787892882.815169:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:7638:1874741455503104:0@lo:502: 00000040:00080000:3.0:1787892882.815485:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787892882.815544:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787892882.815585:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:7638:1874741455503232:0@lo:502: 00000100:00100000:3.0:1787892882.815646:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892882.823142:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071103b7840 going to sleep for 11 seconds 00000100:00100000:1.0:1787892882.823437:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455503232 00000100:00100000:1.0:1787892882.823450:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455503232 00000100:00100000:1.0:1787892882.823512:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787892882.823523:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+13:7638:x1874741455503232:12345-0@lo:502: 00000100:00100000:1.0:1787892882.823937:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+13:7638:x1874741455503232:12345-0@lo:502: Request processed in 413us (8289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892882.823947:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787892882.824607:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:7638:1874741455503232:0@lo:502: 00000040:00080000:3.0:1787892882.825107:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787892882.825125:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1787892882.825705:0:7651:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787892882.825729:0:7651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787892882.829545:0:7651:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787892882.829579:0:7651:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9071072cc000 00000020:00000080:1.0:1787892882.829585:0:7651:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787892882.829674:0:7651:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787892882.829678:0:7651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787892882.829680:0:7651:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787892882.829683:0:7651:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1787892882.830114:0:7638:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787892882.830143:0:7638:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787892882.830172:0:7638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff90710153b600/0x825e3f5022b4a5a3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a5aa expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892882.830187:0:7638:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff90710153b600/0x825e3f5022b4a5a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a5aa expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787892882.830234:0:7638:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787892882.830251:0:7638:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9071072cc000 10000000:01000000:3.0:1787892882.830254:0:7638:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9071072cc000 10000000:01000000:3.0:1787892882.830258:0:7638:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787892882.830265:0:7638:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9071072cc000 from 1 10000000:01000000:3.0:1787892882.830268:0:7638:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787892882.830310:0:7638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff90710153ba00/0x825e3f5022b4a5b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892882.830319:0:7638:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff90710153ba00/0x825e3f5022b4a5b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892882.830331:0:7638:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff90710153ba00/0x825e3f5022b4a5b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892882.830359:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:7638:1874741455503360:0@lo:101: 00000100:00100000:3.0:1787892882.830448:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892882.830506:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071103b7840 going to sleep for 11 seconds 00000100:00100000:1.0:1787892882.830615:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455503360 00000100:00100000:1.0:1787892882.830624:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455503360 00000100:00100000:1.0:1787892882.830678:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787892882.830689:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+13:7638:x1874741455503360:12345-0@lo:101: 00010000:00010000:1.0:1787892882.830705:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787892882.830720:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9071421fbe00/0x825e3f5022b4a5b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4a5b1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892882.830789:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9071421fbe00/0x825e3f5022b4a5b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4a5b1 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892882.830801:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9071421fbe00/0x825e3f5022b4a5b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a5b1 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892882.830810:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071421fbe00, rc 0) 00000100:00100000:1.0:1787892882.830861:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+14:7638:x1874741455503360:12345-0@lo:101: Request processed in 173us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892882.830868:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787892882.831063:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:7638:1874741455503360:0@lo:101: 00010000:00010000:3.0:1787892882.831079:0:7638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff90710153ba00/0x825e3f5022b4a5b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a5b8 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892882.831090:0:7638:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff90710153ba00/0x825e3f5022b4a5b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a5b8 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892882.831191:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:7638:1874741455503488:0@lo:501: 00000100:00100000:3.0:1787892882.831220:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892882.831257:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071103b7840 going to sleep for 11 seconds 00000100:00100000:1.0:1787892882.831310:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455503488 00000100:00100000:1.0:1787892882.831314:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455503488 00000100:00100000:1.0:1787892882.831349:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787892882.831356:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+14:7638:x1874741455503488:12345-0@lo:501: 00000100:00100000:1.0:1787892882.832376:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+14:7638:x1874741455503488:12345-0@lo:501: Request processed in 1015us (1150us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892882.832385:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787892882.833408:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:7638:1874741455503488:0@lo:501: 00000100:00100000:3.0:1787892882.833462:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:7638:1874741455503616:0@lo:503: 00000100:00100000:3.0:1787892882.833528:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892882.833574:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071103b7840 going to sleep for 11 seconds 00000100:00100000:0.0:1787892882.833645:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455503616 00000100:00100000:0.0:1787892882.833654:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455503616 00000100:00100000:0.0:1787892882.833708:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787892882.833718:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+14:7638:x1874741455503616:12345-0@lo:503: 00000100:00100000:0.0:1787892882.834208:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+14:7638:x1874741455503616:12345-0@lo:503: Request processed in 490us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892882.834223:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787892882.834319:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:7638:1874741455503616:0@lo:503: 00000040:00080000:3.0:1787892882.834620:0:7638:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787892882.834688:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:7638:1874741455503744:0@lo:502: 00000100:00100000:3.0:1787892882.834726:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892882.835097:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071103b7840 going to sleep for 11 seconds 00000100:00100000:1.0:1787892882.836130:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455503744 00000100:00100000:1.0:1787892882.836140:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455503744 00000100:00100000:1.0:1787892882.836204:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787892882.836215:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+14:7638:x1874741455503744:12345-0@lo:502: 00000100:00100000:1.0:1787892882.836514:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+14:7638:x1874741455503744:12345-0@lo:502: Request processed in 299us (1787us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892882.836523:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787892882.836687:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:7638:1874741455503744:0@lo:502: 00000040:00080000:2.0:1787892882.837259:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787892882.837317:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787892882.837352:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787892882.837410:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787892882.837449:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787892882.837497:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787892882.837548:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787892882.837584:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787892882.837634:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787892882.837668:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787892882.837702:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787892882.837771:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787892882.837809:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787892882.837857:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787892882.837920:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787892882.837959:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787892882.837994:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787892882.838042:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787892882.838078:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787892882.838112:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787892882.838157:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787892882.838193:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787892882.838241:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787892882.838291:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787892882.838329:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1787892882.838364:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1787892882.838424:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1787892882.838462:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1787892882.838496:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1787892882.838543:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1787892882.838580:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1787892882.838626:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1787892882.838660:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1787892882.838716:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1787892882.838806:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1787892882.838869:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1787892882.838906:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1787892882.838957:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e82a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:7638:1874741455503872:0@lo:502: 00000100:00100000:2.0:1787892882.839025:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892882.839073:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff90713f588840 going to sleep for 11 seconds 00000100:00100000:0.0:1787892882.839239:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455503872 00000100:00100000:0.0:1787892882.839248:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455503872 00000100:00100000:0.0:1787892882.839308:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787892882.839318:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+14:7638:x1874741455503872:12345-0@lo:502: 00000100:00100000:0.0:1787892882.839549:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+14:7638:x1874741455503872:12345-0@lo:502: Request processed in 231us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892882.839556:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787892882.839613:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e82a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:7638:1874741455503872:0@lo:502: 00000040:00080000:0.0:1787892882.839684:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1787892882.839695:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1787892882.840155:0:7652:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787892882.840172:0:7652:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff907105a8b370) 00000020:00000080:0.0:1787892882.840216:0:7652:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1787892882.840300:0:7652:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9071072cc000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787892882.840304:0:7652:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9071072cc000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787892882.840307:0:7652:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9071072cc000 3 00010000:00080000:0.0:1787892882.840338:0:7652:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90713788a000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.129@tcp at head 00010000:00010000:0.0:1787892882.842074:0:7652:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1787892882.846500:0:7652:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787892882.846542:0:7652:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787892882.846561:0:7652:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x825e3f5022b4a5c6 00000100:00080000:1.0:1787892882.846572:0:7652:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787892882.846577:0:7652:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90713788a000 using connection 192.168.202.129@tcp/0@lo 00000100:00100000:1.0:1787892882.846616:0:7652:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff907105afaa00 x1874741455504000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787892882.846657:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907105afaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1874741455504000:0@lo:38: 00000100:00100000:1.0:1787892882.846742:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787892882.846817:0:7652:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787892882.847676:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455504000 00000100:00100000:2.0:1787892882.847690:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455504000 00000100:00100000:2.0:1787892882.847730:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787892882.847952:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105afa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1874741455504000:12345-0@lo:38: 00010000:00080000:2.0:1787892882.847987:0:5849:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:2.0:1787892882.848027:0:5849:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x825e3f5022b4a5cd 00000004:00100000:2.0:1787892882.848046:0:5849:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787892882.848081:0:5849:0:(import.c:65:import_set_state_nolock()) ffff90713f77b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787892882.848199:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105afa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874741455504000:12345-0@lo:38: Request processed in 248us (1465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892882.848207:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787892882.848294:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787892882.848307:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874741455504128:0@lo:400: 00000100:00100000:2.0:1787892882.848338:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892882.848368:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455504384:0@lo:400: 00000100:00100000:2.0:1787892882.848393:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892882.848421:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787892882.848427:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874741455504256:0@lo:400: 00000100:00100000:2.0:1787892882.848448:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892882.848492:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455504128 00000100:00100000:2.0:1787892882.848497:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455504128 00000100:00100000:2.0:1787892882.848519:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455504256 00000100:00100000:2.0:1787892882.848521:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455504256 00000100:00100000:2.0:1787892882.848535:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787892882.848541:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107e80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874741455504128:12345-0@lo:400: 00000100:00100000:2.0:1787892882.848593:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107e80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874741455504128:12345-0@lo:400: Request processed in 51us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892882.848600:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787892882.848612:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787892882.848617:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107e83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874741455504256:12345-0@lo:400: 00000100:00100000:2.0:1787892882.848644:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107e83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874741455504256:12345-0@lo:400: Request processed in 28us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892882.848650:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787892882.848666:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455504384 00000100:00100000:2.0:1787892882.848669:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455504384 00000100:00100000:2.0:1787892882.848691:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787892882.848696:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107e82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455504384:12345-0@lo:400: 00000100:00100000:2.0:1787892882.848722:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107e82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455504384:12345-0@lo:400: Request processed in 26us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892882.848728:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787892882.850881:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff907107e81180 x1874741455504128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892882.850903:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874741455504128:0@lo:400: 00010000:00080000:2.0:1787892882.850946:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff907107e81880 x1874741455504256/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892882.850955:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874741455504256:0@lo:400: 00010000:00080000:2.0:1787892882.850986:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff907107e81500 x1874741455504384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892882.850993:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455504384:0@lo:400: 00000040:00080000:3.0:1787892882.851243:0:7652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:2.0:1787892882.851507:0:7653:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff907107e81500 x1874741455504512/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892882.851516:0:7653:0:(client.c:2715:ptlrpc_set_wait()) set ffff90713f588f00 going to sleep for 0 seconds 00000020:01000000:0.0:1787892882.851603:0:7638:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1787892882.851630:0:7638:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787892882.851656:0:7638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff90710153ba00/0x825e3f5022b4a5b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a5b8 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892882.851667:0:7638:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff90710153ba00/0x825e3f5022b4a5b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a5b8 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787892882.851713:0:7638:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787892882.851720:0:7638:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787892882.851721:0:7638:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787892882.851722:0:7638:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787892882.851724:0:7638:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787892882.851725:0:7638:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787892882.851726:0:7638:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787892882.851728:0:7638:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787892882.851730:0:7638:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787892882.851744:0:7638:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787892882.851745:0:7638:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787892882.851775:0:7638:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1787892882.851778:0:7638:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787892882.851779:0:7638:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787892882.851780:0:7638:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787892882.851781:0:7638:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787892882.851782:0:7638:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787892882.851783:0:7638:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787892882.851784:0:7638:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787892882.851785:0:7638:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787892882.851786:0:7638:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787892882.851787:0:7638:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787892882.851788:0:7638:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787892882.851803:0:7638:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787892882.851813:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:7638:1874741455504640:0@lo:253: 00000100:00100000:0.0:1787892882.851898:0:7638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892882.851938:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff907109145240 going to sleep for 11 seconds 00000100:00100000:3.0:1787892882.853412:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455504640 00000100:00100000:3.0:1787892882.853430:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455504640 00000100:00100000:3.0:1787892882.853499:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787892882.853510:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+14:7638:x1874741455504640:12345-0@lo:253: 20000000:01000000:3.0:1787892882.853546:0:5842:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787892882.853570:0:5842:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:1.0:1787892882.856128:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff907105afaa00 x1874741455504000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787892892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892882.856146:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787892882.856158:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1787892882.856168:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787892882.856173:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787892882.856187:0:3304:0:(import.c:65:import_set_state_nolock()) ffff90713788a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1787892882.856196:0:3304:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000e4496034): req@ffff907107e81500 x1874741455504512/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892882.856225:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907105afaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1874741455504000:0@lo:38: 00000100:00100000:0.0:1787892882.856548:0:7653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892882.856586:0:7653:0:(client.c:2715:ptlrpc_set_wait()) set ffff90713f588f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787892882.856835:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455504512 00000100:00100000:1.0:1787892882.856842:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455504512 00000100:00100000:1.0:1787892882.856899:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787892882.856910:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7653:x1874741455504512:12345-0@lo:901: 00000100:00100000:1.0:1787892882.857283:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7653:x1874741455504512:12345-0@lo:901: Request processed in 374us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892882.857290:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787892882.857418:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787892882.857446:0:7653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff907107e81500 x1874741455504512/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787892898 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892882.857460:0:7653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e81500 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7653:1874741455504512:0@lo:901: 20000000:01000000:0.0:1787892882.892540:0:5842:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787892882.892555:0:5842:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787892882.892577:0:5863:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787892882.892581:0:5863:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787892882.892617:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907100031e00/0x825e3f5022b4a5d4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892882.892636:0:5863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907100031800/0x825e3f5022b4a525 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a51e expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892882.892644:0:5863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907100031e00/0x825e3f5022b4a5d4 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892882.892687:0:5863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907100031800/0x825e3f5022b4a525 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x825e3f5022b4a51e expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892882.892701:0:5863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907100031800/0x825e3f5022b4a525 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x825e3f5022b4a51e expref: 14 pid: 5843 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892882.892715:0:5863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f3b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5863:1874741455504768:0@lo:104: 00000100:00100000:0.0:1787892882.893178:0:5863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892882.893237:0:5863:0:(client.c:2715:ptlrpc_set_wait()) set ffff907139cde9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787892882.893263:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455504768 00000100:00100000:0.0:1787892882.893272:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455504768 00000100:00100000:0.0:1787892882.893325:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787892882.893335:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22d910cf-711e-44e0-9acf-212404ada550+3:5863:x1874741455504768:12345-0@lo:104: 00010000:00010000:0.0:1787892882.893348:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9071013fd400/0x825e3f5022b4a51e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a525 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892882.893401:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787892882.893407:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22d910cf-711e-44e0-9acf-212404ada550+3:5863:x1874741455504768:12345-0@lo:104: Request processed in 74us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892882.893415:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1787892882.893442:0:7644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787892882.895954:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9071013fd400/0x825e3f5022b4a51e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a525 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892882.895968:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071013fd400 already unused, calling callback (ffffffffc1c05c20) 10000000:00010000:0.0:1787892882.895972:0:7644:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9071013fd400/0x825e3f5022b4a51e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x825e3f5022b4a525 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892882.895981:0:7644:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9071013fd400/0x825e3f5022b4a51e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x825e3f5022b4a525 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787892882.895988:0:7644:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9071013fd400/0x825e3f5022b4a51e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x825e3f5022b4a525 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787892882.895994:0:7644:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787892882.896091:0:7644:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9071013fd400/0x825e3f5022b4a51e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a525 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892882.896098:0:7644:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787892882.896124:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9071013fd400/0x825e3f5022b4a51e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a525 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892882.896132:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9071013fd400/0x825e3f5022b4a51e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a525 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892882.896153:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787892882.896156:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787892882.896158:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787892882.896159:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455504896:0@lo:103: 00000100:00100000:3.0:1787892882.896242:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892882.896320:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455504896 00000100:00100000:3.0:1787892882.896327:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455504896 00010000:00010000:3.0:1787892882.896357:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907100031800/0x825e3f5022b4a525 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a51e expref: 15 pid: 5843 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892882.896389:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787892882.896398:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107f2a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22d910cf-711e-44e0-9acf-212404ada550+15:3305:x1874741455504896:12345-0@lo:103: 00010000:00010000:3.0:1787892882.896423:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787892882.896428:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907100031800/0x825e3f5022b4a525 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a51e expref: 15 pid: 5843 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892882.896441:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907100031800/0x825e3f5022b4a525 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x825e3f5022b4a51e expref: 15 pid: 5843 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892882.896466:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff907100031e00/0x825e3f5022b4a5d4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892882.896474:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907100031e00/0x825e3f5022b4a5d4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787892882.896488:0:5834:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003907999s 00010000:00010000:3.0:1787892882.896492:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907100031e00/0x825e3f5022b4a5d4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892882.896500:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907100031e00/0x825e3f5022b4a5d4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892882.896507:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907100031e00/0x825e3f5022b4a5d4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892882.896512:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907100031800/0x825e3f5022b4a525 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x825e3f5022b4a51e expref: 15 pid: 5843 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892882.896515:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907100031e00/0x825e3f5022b4a5d4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892882.896530:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907100031e00 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:3.0:1787892882.896535:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907100031e00/0x825e3f5022b4a5d4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892882.896539:0:5863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f3b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5863:1874741455504768:0@lo:104: 00010000:00010000:3.0:1787892882.896544:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907100031e00/0x825e3f5022b4a5d4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892882.896560:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907100031e00/0x825e3f5022b4a5d4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892882.896569:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787892882.896570:0:5863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907100031e00/0x825e3f5022b4a5d4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892882.896581:0:5863:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907100031e00/0x825e3f5022b4a5d4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892882.896588:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907100031e00/0x825e3f5022b4a5d4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892882.896595:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907100031e00/0x825e3f5022b4a5d4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892882.897095:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107f2a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22d910cf-711e-44e0-9acf-212404ada550+14:3305:x1874741455504896:12345-0@lo:103: Request processed in 695us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892882.897122:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787892882.897710:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455504896:0@lo:103: 00000100:00100000:0.0:1787892882.909619:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+13:7638:x1874741455504640:12345-0@lo:253: Request processed in 56094us (57704us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892882.909643:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787892882.910035:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:22d910cf-711e-44e0-9acf-212404ada550:7638:1874741455504640:0@lo:253: 10000000:01000000:2.0:1787892882.910054:0:7638:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787892882.910058:0:7638:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787892882.910060:0:7638:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787892882.910061:0:7638:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787892882.910062:0:7638:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787892882.910064:0:7638:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787892882.910065:0:7638:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787892882.910066:0:7638:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787892882.910068:0:7638:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787892882.910069:0:7638:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787892882.910072:0:7638:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787892882.910073:0:7638:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787892882.910094:0:7638:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787892882.924440:0:7638:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787892882.924619:0:7638:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787892882.928455:0:7638:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787892882.929106:0:7638:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787892882.929356:0:7638:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787892882.929580:0:7638:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787892882.932840:0:7638:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1787892883.239568:0:7638:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787892883.239586:0:7638:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787892883.239621:0:7638:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787892883.239680:0:7638:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.129@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787892883.239695:0:7638:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787892883.239723:0:7638:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1787892883.529364:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892884.555120:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787892885.584590:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787892886.225669:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787892886.225698:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455505024:0@lo:13: 00000100:00100000:1.0:1787892886.225813:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892886.226217:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455505024 00000100:00100000:3.0:1787892886.226227:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455505024 00000100:00100000:3.0:1787892886.226291:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787892886.226301:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105afaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455505024:12345-0@lo:13: 00002000:00000024:3.0:1787892886.226341:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787892886.226399:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105afaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455505024:12345-0@lo:13: Request processed in 99us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892886.226407:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1787892886.226464:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787892886.226494:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90712ebbf480 x1874741455505024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892902 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892886.226514:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455505024:0@lo:13: 00010000:00010000:0.0:1787892886.602316:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787892887.625181:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787892888.268001:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22d910cf-711e-44e0-9acf-212404ada550:3307:1874741455505152:0@lo:400: 00000100:00100000:0.0:1787892888.268081:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892888.268134:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874741455505664:0@lo:400: 00000100:00100000:0.0:1787892888.268162:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892888.268191:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787892888.268197:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874741455505280:0@lo:400: 00000100:00100000:0.0:1787892888.268220:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892888.268257:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874741455505408:0@lo:400: 00000100:00100000:0.0:1787892888.268283:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892888.268301:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787892888.268307:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455505536:0@lo:400: 00000100:00100000:0.0:1787892888.268333:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892888.268364:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455505152 00000100:00100000:0.0:1787892888.268372:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455505152 00000100:00100000:0.0:1787892888.268419:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787892888.268428:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+13:3307:x1874741455505152:12345-0@lo:400: 00000100:00100000:0.0:1787892888.268476:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+13:3307:x1874741455505152:12345-0@lo:400: Request processed in 49us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892888.268484:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787892888.268516:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455505664 00000100:00100000:0.0:1787892888.268520:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455505664 00000100:00100000:0.0:1787892888.268549:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455505280 00000100:00100000:0.0:1787892888.268552:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455505280 00000100:00100000:0.0:1787892888.268562:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455505408 00000100:00100000:0.0:1787892888.268565:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455505408 00000100:00100000:0.0:1787892888.268577:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787892888.268583:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874741455505664:12345-0@lo:400: 00000100:00100000:0.0:1787892888.268613:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874741455505664:12345-0@lo:400: Request processed in 30us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892888.268619:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787892888.268631:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787892888.268637:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874741455505280:12345-0@lo:400: 00000100:00100000:0.0:1787892888.268663:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874741455505280:12345-0@lo:400: Request processed in 27us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892888.268669:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787892888.268688:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787892888.268695:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874741455505408:12345-0@lo:400: 00000100:00100000:0.0:1787892888.268725:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874741455505408:12345-0@lo:400: Request processed in 31us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892888.268731:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787892888.268788:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455505536 00000100:00100000:0.0:1787892888.268791:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455505536 00000100:00100000:0.0:1787892888.270060:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787892888.270075:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455505536:12345-0@lo:400: 00000100:00100000:0.0:1787892888.270143:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455505536:12345-0@lo:400: Request processed in 73us (1809us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892888.270149:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787892888.270216:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90712e2f3480 x1874741455505280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892888.270233:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874741455505280:0@lo:400: 00000100:00100000:0.0:1787892888.270244:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22d910cf-711e-44e0-9acf-212404ada550:3307:1874741455505152:0@lo:400: 00010000:00080000:0.0:1787892888.270253:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9070038c2680 x1874741455505664/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892888.270262:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874741455505664:0@lo:400: 00000100:00080000:0.0:1787892888.270300:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787892888.270306:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787892888.270324:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9070038c0e00 x1874741455505536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892888.270333:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455505536:0@lo:400: 00010000:00080000:0.0:1787892888.270345:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90712e2f3800 x1874741455505408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892888.270365:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874741455505408:0@lo:400: 00010000:00010000:0.0:1787892888.650947:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787892889.412372:0:7995:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg229-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787892889.677323:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892890.699839:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787892891.338790:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787892891.338821:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455505792:0@lo:13: 00000100:00100000:1.0:1787892891.338911:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892891.339055:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455505792 00000100:00100000:3.0:1787892891.339066:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455505792 00000100:00100000:3.0:1787892891.339145:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787892891.339156:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105af8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455505792:12345-0@lo:13: 00002000:00000024:3.0:1787892891.339202:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787892891.339270:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105af8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455505792:12345-0@lo:13: Request processed in 116us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892891.339278:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787892891.339477:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787892891.339508:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90712ebbf100 x1874741455505792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892907 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892891.339539:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455505792:0@lo:13: 00010000:00010000:0.0:1787892891.721119:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787892892.360905:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787892892.360913:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff907105af0000 from 30 10000000:01000000:2.0:1787892892.360920:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787892892.360984:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9071013fcc00/0x825e3f5022b4a5db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892892.360996:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9071013fcc00/0x825e3f5022b4a5db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892892.361007:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9071013fcc00/0x825e3f5022b4a5db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892892.361045:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e81880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455505920:0@lo:101: 00000100:00100000:2.0:1787892892.361117:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892892.361222:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff90713f4a6540 going to sleep for 11 seconds 00000100:00100000:0.0:1787892892.361565:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455505920 00000100:00100000:0.0:1787892892.361574:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455505920 00000100:00100000:0.0:1787892892.361630:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787892892.361642:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+13:5846:x1874741455505920:12345-0@lo:101: 00010000:00010000:0.0:1787892892.361656:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787892892.361670:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907100031e00/0x825e3f5022b4a5e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4a5db expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892892.361693:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907100031e00/0x825e3f5022b4a5e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4a5db expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892892.361713:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907100031e00/0x825e3f5022b4a5e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a5db expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892892.361722:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907100031e00, rc 0) 00000100:00100000:0.0:1787892892.361818:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+14:5846:x1874741455505920:12345-0@lo:101: Request processed in 178us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892892.361825:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787892892.362714:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e81880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455505920:0@lo:101: 00010000:00010000:3.0:1787892892.362741:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9071013fcc00/0x825e3f5022b4a5db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a5e2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892892.362773:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9071013fcc00/0x825e3f5022b4a5db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a5e2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892892.362852:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455506048:0@lo:501: 00000100:00100000:3.0:1787892892.362889:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892892.362927:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071103b79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787892892.363389:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455506048 00000100:00100000:2.0:1787892892.363397:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455506048 00000100:00100000:2.0:1787892892.363457:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787892892.363468:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+14:5846:x1874741455506048:12345-0@lo:501: 00000100:00100000:2.0:1787892892.364156:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+14:5846:x1874741455506048:12345-0@lo:501: Request processed in 685us (1261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892892.364165:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787892892.365070:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455506048:0@lo:501: 00000100:00100000:3.0:1787892892.365112:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455506176:0@lo:503: 00000100:00100000:3.0:1787892892.365156:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892892.365191:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071103b79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787892892.367266:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455506176 00000100:00100000:2.0:1787892892.367291:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455506176 00000100:00100000:2.0:1787892892.367355:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787892892.367364:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+14:5846:x1874741455506176:12345-0@lo:503: 00000100:00100000:2.0:1787892892.367882:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+14:5846:x1874741455506176:12345-0@lo:503: Request processed in 518us (2724us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892892.367891:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787892892.368176:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455506176:0@lo:503: 00000100:00100000:3.0:1787892892.375274:0:8099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8099:1874741455506304:0@lo:502: 00000100:00100000:3.0:1787892892.375913:0:8099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892892.376030:0:8099:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071103b7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787892892.376208:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455506304 00000100:00100000:0.0:1787892892.376216:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455506304 00000100:00100000:0.0:1787892892.376268:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787892892.376344:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+14:8099:x1874741455506304:12345-0@lo:502: 00000100:00100000:0.0:1787892892.377127:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+14:8099:x1874741455506304:12345-0@lo:502: Request processed in 847us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892892.377150:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787892892.379151:0:8099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8099:1874741455506304:0@lo:502: 00000100:00100000:3.0:1787892892.379253:0:8099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8099:1874741455506432:0@lo:502: 00000100:00100000:3.0:1787892892.379638:0:8099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892892.379747:0:8099:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071103b7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787892892.387649:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455506432 00000100:00100000:1.0:1787892892.387668:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455506432 00000100:00100000:1.0:1787892892.387777:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787892892.387787:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+14:8099:x1874741455506432:12345-0@lo:502: 00000100:00100000:1.0:1787892892.388252:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+14:8099:x1874741455506432:12345-0@lo:502: Request processed in 465us (8613us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892892.388259:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787892892.388428:0:8099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8099:1874741455506432:0@lo:502: 00000040:00080000:3.0:1787892892.388465:0:8099:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787892892.389193:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787892892.389218:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787892892.389229:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9071013fcc00/0x825e3f5022b4a5db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a5e2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892892.389240:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9071013fcc00/0x825e3f5022b4a5db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a5e2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787892892.389249:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787892892.389252:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1787892892.389254:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787892892.389296:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff907100031800/0x825e3f5022b4a5e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892892.389304:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff907100031800/0x825e3f5022b4a5e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892892.389314:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff907100031800/0x825e3f5022b4a5e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892892.389333:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455506560:0@lo:101: 00000100:00100000:0.0:1787892892.389391:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892892.389600:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff907108643780 going to sleep for 11 seconds 00000100:00100000:3.0:1787892892.394261:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455506560 00000100:00100000:3.0:1787892892.394278:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455506560 00000100:00100000:2.0:1787892892.398063:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787892892.398079:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+14:5846:x1874741455506560:12345-0@lo:101: 00010000:00010000:2.0:1787892892.398099:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787892892.398120:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9071013fde00/0x825e3f5022b4a5f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4a5e9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892892.398152:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9071013fde00/0x825e3f5022b4a5f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4a5e9 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892892.398183:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9071013fde00/0x825e3f5022b4a5f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a5e9 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892892.398193:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071013fde00, rc 0) 00000100:00100000:2.0:1787892892.398271:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+15:5846:x1874741455506560:12345-0@lo:101: Request processed in 196us (8880us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892892.398416:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455506560:0@lo:101: 00010000:00010000:0.0:1787892892.398438:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff907100031800/0x825e3f5022b4a5e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a5f0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892892.398449:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff907100031800/0x825e3f5022b4a5e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a5f0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892892.398475:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787892892.398526:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455506688:0@lo:501: 00000100:00100000:0.0:1787892892.398560:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892892.398594:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff907108643780 going to sleep for 11 seconds 00000100:00100000:2.0:1787892892.398624:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455506688 00000100:00100000:2.0:1787892892.398631:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455506688 00000100:00100000:2.0:1787892892.398664:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787892892.398671:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+15:5846:x1874741455506688:12345-0@lo:501: 00000100:00100000:2.0:1787892892.399388:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+15:5846:x1874741455506688:12345-0@lo:501: Request processed in 714us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892892.399397:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787892892.401640:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455506688:0@lo:501: 00000100:00100000:0.0:1787892892.401857:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455506816:0@lo:503: 00000100:00100000:0.0:1787892892.402067:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892892.402119:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff907108643780 going to sleep for 11 seconds 00000100:00100000:2.0:1787892892.402218:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455506816 00000100:00100000:2.0:1787892892.402228:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455506816 00000100:00100000:2.0:1787892892.402423:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787892892.402434:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+15:5846:x1874741455506816:12345-0@lo:503: 00000100:00100000:2.0:1787892892.402840:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+15:5846:x1874741455506816:12345-0@lo:503: Request processed in 406us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892892.402849:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787892892.402874:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455506816:0@lo:503: 00000100:00100000:0.0:1787892892.406519:0:8100:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8100:1874741455506944:0@lo:502: 00000100:00100000:0.0:1787892892.406632:0:8100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892892.406693:0:8100:0:(client.c:2715:ptlrpc_set_wait()) set ffff907108643180 going to sleep for 11 seconds 00000100:00100000:1.0:1787892892.407121:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455506944 00000100:00100000:1.0:1787892892.407133:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455506944 00000100:00100000:1.0:1787892892.407188:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787892892.407199:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+15:8100:x1874741455506944:12345-0@lo:502: 00000100:00100000:1.0:1787892892.407534:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+15:8100:x1874741455506944:12345-0@lo:502: Request processed in 335us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892892.407543:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787892892.408004:0:8100:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8100:1874741455506944:0@lo:502: 00000020:01000000:0.0:1787892892.408040:0:8100:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787892892.408050:0:8100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787892892.408053:0:8100:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787892892.408058:0:8100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787892892.408060:0:8100:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787892892.408084:0:8100:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8100:1874741455507072:0@lo:502: 00000100:00100000:0.0:1787892892.408126:0:8100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892892.408153:0:8100:0:(client.c:2715:ptlrpc_set_wait()) set ffff907108643180 going to sleep for 11 seconds 00000100:00100000:1.0:1787892892.408338:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455507072 00000100:00100000:1.0:1787892892.408343:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455507072 00000100:00100000:1.0:1787892892.408391:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787892892.408399:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+15:8100:x1874741455507072:12345-0@lo:502: 00000100:00100000:1.0:1787892892.408672:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+15:8100:x1874741455507072:12345-0@lo:502: Request processed in 273us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892892.408686:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787892892.408874:0:8100:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8100:1874741455507072:0@lo:502: 00000020:01000000:0.0:1787892892.408897:0:8100:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787892892.408904:0:8100:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787892892.408906:0:8100:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787892892.408910:0:8100:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1787892892.409645:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1787892892.409669:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787892892.409681:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff907100031800/0x825e3f5022b4a5e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a5f0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892892.409701:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff907100031800/0x825e3f5022b4a5e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a5f0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787892892.409721:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787892892.409723:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90710510c800 from 30 10000000:01000000:3.0:1787892892.409727:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787892892.409912:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff90710153be00/0x825e3f5022b4a5f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892892.409921:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff90710153be00/0x825e3f5022b4a5f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892892.409933:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff90710153be00/0x825e3f5022b4a5f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892892.410019:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455507200:0@lo:101: 00000100:00100000:3.0:1787892892.410068:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892892.410096:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071103b79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787892892.410179:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455507200 00000100:00100000:0.0:1787892892.410193:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455507200 00000100:00100000:0.0:1787892892.410240:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787892892.410249:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+15:5846:x1874741455507200:12345-0@lo:101: 00010000:00010000:0.0:1787892892.410262:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787892892.410275:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907100030800/0x825e3f5022b4a5fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4a5f7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892892.410307:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907100030800/0x825e3f5022b4a5fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4a5f7 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892892.410317:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907100030800/0x825e3f5022b4a5fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a5f7 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892892.410326:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907100030800, rc 0) 00000100:00100000:0.0:1787892892.410581:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+16:5846:x1874741455507200:12345-0@lo:101: Request processed in 331us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892892.410589:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787892892.410670:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455507200:0@lo:101: 00010000:00010000:3.0:1787892892.410685:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff90710153be00/0x825e3f5022b4a5f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a5fe expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892892.410693:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff90710153be00/0x825e3f5022b4a5f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a5fe expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892892.410944:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455507328:0@lo:501: 00000100:00100000:0.0:1787892892.411060:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892892.411093:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff907108643480 going to sleep for 11 seconds 00000100:00100000:2.0:1787892892.411160:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455507328 00000100:00100000:2.0:1787892892.411167:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455507328 00000100:00100000:2.0:1787892892.411193:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787892892.411200:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+16:5846:x1874741455507328:12345-0@lo:501: 00000100:00100000:2.0:1787892892.412117:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+16:5846:x1874741455507328:12345-0@lo:501: Request processed in 910us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892892.412135:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787892892.421663:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455507328:0@lo:501: 00000100:00100000:0.0:1787892892.421779:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455507456:0@lo:503: 00000100:00100000:0.0:1787892892.421884:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892892.421933:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff907108643480 going to sleep for 11 seconds 00000100:00100000:1.0:1787892892.422371:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455507456 00000100:00100000:1.0:1787892892.422380:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455507456 00000100:00100000:1.0:1787892892.422444:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787892892.422456:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+16:5846:x1874741455507456:12345-0@lo:503: 00000100:00100000:1.0:1787892892.422713:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+16:5846:x1874741455507456:12345-0@lo:503: Request processed in 258us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892892.422721:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787892892.423224:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455507456:0@lo:503: 00000100:00100000:2.0:1787892892.425216:0:8101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e81180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8101:1874741455507584:0@lo:502: 00000100:00100000:2.0:1787892892.425307:0:8101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892892.425359:0:8101:0:(client.c:2715:ptlrpc_set_wait()) set ffff90712c4cca80 going to sleep for 11 seconds 00000100:00100000:0.0:1787892892.425566:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455507584 00000100:00100000:0.0:1787892892.425574:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455507584 00000100:00100000:0.0:1787892892.425643:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787892892.425653:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+16:8101:x1874741455507584:12345-0@lo:502: 00000100:00100000:0.0:1787892892.426118:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+16:8101:x1874741455507584:12345-0@lo:502: Request processed in 465us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892892.426127:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787892892.426287:0:8101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e81180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8101:1874741455507584:0@lo:502: 00000100:00100000:2.0:1787892892.426342:0:8101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e81180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8101:1874741455507712:0@lo:502: 00000100:00100000:2.0:1787892892.426388:0:8101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892892.426481:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455507712 00000100:00100000:3.0:1787892892.426486:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455507712 00000100:00100000:3.0:1787892892.426520:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787892892.426534:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+16:8101:x1874741455507712:12345-0@lo:502: 00000100:00100000:3.0:1787892892.433981:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+16:8101:x1874741455507712:12345-0@lo:502: Request processed in 7433us (7578us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892892.434000:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787892892.434193:0:8101:0:(client.c:2715:ptlrpc_set_wait()) set ffff90712c4cca80 going to sleep for 11 seconds 00000100:00100000:2.0:1787892892.434231:0:8101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e81180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8101:1874741455507712:0@lo:502: 00000040:00080000:2.0:1787892892.434289:0:8101:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787892892.438640:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787892892.438682:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787892892.438695:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff90710153be00/0x825e3f5022b4a5f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a5fe expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892892.438914:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff90710153be00/0x825e3f5022b4a5f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a5fe expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787892892.439507:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787892892.439512:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90710510c800 from 5 10000000:01000000:1.0:1787892892.439517:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787892892.439578:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9071421fb200/0x825e3f5022b4a605 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892892.439588:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9071421fb200/0x825e3f5022b4a605 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892892.439601:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9071421fb200/0x825e3f5022b4a605 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892892.439631:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907105afbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455507840:0@lo:101: 00000100:00100000:1.0:1787892892.440505:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892892.440600:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071298b4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787892892.442934:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455507840 00000100:00100000:2.0:1787892892.442959:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455507840 00000100:00100000:2.0:1787892892.443018:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787892892.443028:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+16:5846:x1874741455507840:12345-0@lo:101: 00010000:00010000:2.0:1787892892.443046:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787892892.443067:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9071013fce00/0x825e3f5022b4a60c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4a605 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892892.443094:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9071013fce00/0x825e3f5022b4a60c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4a605 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892892.443107:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9071013fce00/0x825e3f5022b4a60c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a605 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892892.443117:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071013fce00, rc 0) 00000100:00100000:2.0:1787892892.443433:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+17:5846:x1874741455507840:12345-0@lo:101: Request processed in 405us (2931us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892892.443456:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787892892.448926:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907105afbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455507840:0@lo:101: 00010000:00010000:0.0:1787892892.448969:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9071421fb200/0x825e3f5022b4a605 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a60c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892892.448983:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9071421fb200/0x825e3f5022b4a605 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a60c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892892.449264:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e81180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455507968:0@lo:256: 00000100:00100000:2.0:1787892892.449357:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892892.449396:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff90712c4cc0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787892892.450422:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455507968 00000100:00100000:3.0:1787892892.450433:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455507968 00000100:00100000:3.0:1787892892.450479:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787892892.450488:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+17:5846:x1874741455507968:12345-0@lo:256: 20000000:01000000:3.0:1787892892.450508:0:5841:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787892892.450530:0:5841:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787892892.450533:0:5841:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1787892892.450641:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+17:5846:x1874741455507968:12345-0@lo:256: Request processed in 153us (1294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892892.450649:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787892892.450877:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e81180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455507968:0@lo:256: 10000000:01000000:2.0:1787892892.450924:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787892892.450933:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9071421fb200/0x825e3f5022b4a605 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a60c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892892.450943:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9071421fb200/0x825e3f5022b4a605 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a60c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892892.450963:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787892892.450966:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1787892892.450969:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787892892.450993:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9071013fca00/0x825e3f5022b4a613 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892892.451001:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9071013fca00/0x825e3f5022b4a613 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892892.451011:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9071013fca00/0x825e3f5022b4a613 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892892.451026:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e81180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455508096:0@lo:101: 00000100:00100000:2.0:1787892892.451055:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892892.451084:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff90712c4cc0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787892892.451389:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455508096 00000100:00100000:0.0:1787892892.451395:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455508096 00000100:00100000:0.0:1787892892.451435:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787892892.451442:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+17:5846:x1874741455508096:12345-0@lo:101: 00010000:00010000:0.0:1787892892.451453:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787892892.451466:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907100031400/0x825e3f5022b4a61a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4a613 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892892.451487:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907100031400/0x825e3f5022b4a61a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4a613 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892892.451509:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907100031400/0x825e3f5022b4a61a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a613 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892892.451518:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907100031400, rc 0) 00000100:00100000:0.0:1787892892.451561:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+18:5846:x1874741455508096:12345-0@lo:101: Request processed in 120us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892892.451568:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787892892.451675:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e81180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455508096:0@lo:101: 00010000:00010000:2.0:1787892892.451692:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9071013fca00/0x825e3f5022b4a613 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a61a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892892.451713:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9071013fca00/0x825e3f5022b4a613 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a61a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892892.451795:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e81180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455508224:0@lo:501: 00000100:00100000:2.0:1787892892.451821:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892892.451843:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff90712c4cc0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787892892.451897:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455508224 00000100:00100000:1.0:1787892892.451902:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455508224 00000100:00100000:1.0:1787892892.451928:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787892892.451937:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+18:5846:x1874741455508224:12345-0@lo:501: 00000100:00100000:1.0:1787892892.452223:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+18:5846:x1874741455508224:12345-0@lo:501: Request processed in 286us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892892.452236:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787892892.452818:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e81180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455508224:0@lo:501: 00000100:00100000:2.0:1787892892.452854:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e81180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455508352:0@lo:503: 00000100:00100000:2.0:1787892892.452900:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892892.452932:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff90712c4cc0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787892892.453052:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455508352 00000100:00100000:1.0:1787892892.453058:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455508352 00000100:00100000:1.0:1787892892.453087:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787892892.453095:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+18:5846:x1874741455508352:12345-0@lo:503: 00000100:00100000:1.0:1787892892.453513:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+18:5846:x1874741455508352:12345-0@lo:503: Request processed in 416us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892892.453520:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787892892.454413:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e81180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455508352:0@lo:503: 00000100:00100000:1.0:1787892892.459176:0:8102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907105afbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8102:1874741455508480:0@lo:502: 00000100:00100000:1.0:1787892892.459274:0:8102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892892.459323:0:8102:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071298b4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787892892.459362:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455508480 00000100:00100000:2.0:1787892892.459370:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455508480 00000100:00100000:2.0:1787892892.459425:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787892892.459434:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+18:8102:x1874741455508480:12345-0@lo:502: 00000100:00100000:2.0:1787892892.459822:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+18:8102:x1874741455508480:12345-0@lo:502: Request processed in 387us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892892.459830:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787892892.460029:0:8102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907105afbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8102:1874741455508480:0@lo:502: 00000020:01000000:3.0:1787892892.460068:0:8102:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787892892.460077:0:8102:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787892892.460084:0:8102:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787892892.460086:0:8102:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787892892.460091:0:8102:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787892892.460095:0:8102:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.129@tcp to nid 0x20000c0a8ca81 (192.168.202.129@tcp) 00000020:01000000:3.0:1787892892.460119:0:8102:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787892892.460122:0:8102:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787892892.460137:0:8102:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff90712ea7cd28) 00000020:00000080:3.0:1787892892.460167:0:8102:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1787892892.460174:0:8102:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787892892.460248:0:8102:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787892892.460253:0:8102:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787892892.460267:0:8102:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x825e3f5022b4a628 00010000:00080000:3.0:1787892892.460295:0:8102:0:(ldlm_lib.c:102:import_set_conn()) imp ffff907139bb2000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.129@tcp at head 00010000:00010000:3.0:1787892892.460515:0:8102:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1787892892.461108:0:8102:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1787892892.461120:0:8102:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787892892.461637:0:8102:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787892892.464401:0:8102:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787892892.464478:0:8102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1787892892.464550:0:8102:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1787892892.467058:0:8103:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787892892.467065:0:8103:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787892892.468130:0:8102:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787892892.468146:0:8102:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787892892.468188:0:8102:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787892892.468211:0:8102:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x825e3f5022b4a62f 00000100:00080000:2.0:1787892892.468221:0:8102:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787892892.468227:0:8102:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff907139bb2000 using connection 192.168.202.129@tcp/0@lo 00000100:00100000:2.0:1787892892.468271:0:8102:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff907107e81180 x1874741455508608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787892892.468329:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874741455508608:0@lo:8: 00000100:00100000:1.0:1787892892.468414:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787892892.468485:0:8102:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787892892.468537:0:8102:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787892892.468541:0:8102:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787892892.468543:0:8102:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787892892.468546:0:8102:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787892892.468549:0:8102:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787892892.468551:0:8102:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787892892.468554:0:8102:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787892892.468556:0:8102:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787892892.468581:0:8102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e81c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8102:1874741455508736:0@lo:502: 00000100:00100000:2.0:1787892892.468626:0:8102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892892.468654:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455508736 00000100:00100000:2.0:1787892892.468661:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455508736 00000100:00100000:2.0:1787892892.468700:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787892892.468709:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+18:8102:x1874741455508736:12345-0@lo:502: 00000100:00100000:3.0:1787892892.469189:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455508608 00000100:00100000:3.0:1787892892.469194:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455508608 00000100:00100000:3.0:1787892892.469216:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787892892.469222:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105afa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1874741455508608:12345-0@lo:8: 00010000:00080000:3.0:1787892892.469242:0:6700:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 220 last 0 00000020:00000080:3.0:1787892892.469265:0:6700:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x825e3f5022b4a636 00002000:00100000:3.0:1787892892.469276:0:6700:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff907139bb1800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1787892892.469280:0:6700:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1787892892.469284:0:6700:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1787892892.469383:0:6700:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787892892.469518:0:6700:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787892892.469543:0:6700:0:(import.c:65:import_set_state_nolock()) ffff907139bb2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787892892.471963:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874741455508864:0@lo:400: 00000100:00100000:0.0:1787892892.475971:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892892.476028:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787892892.476043:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874741455508992:0@lo:400: 00000100:00100000:0.0:1787892892.476085:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892892.476127:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455509120:0@lo:400: 00000100:00100000:0.0:1787892892.476155:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892892.476179:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787892892.476186:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874741455509248:0@lo:400: 00000100:00100000:0.0:1787892892.476206:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892892.476240:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455508864 00000100:00100000:0.0:1787892892.476248:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455508864 00000100:00100000:0.0:1787892892.476297:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455508992 00000100:00100000:0.0:1787892892.476300:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455508992 00000100:00100000:0.0:1787892892.476323:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455509248 00000100:00100000:0.0:1787892892.476325:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455509248 00000100:00100000:0.0:1787892892.476340:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787892892.476357:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874741455508864:12345-0@lo:400: 00000100:00100000:0.0:1787892892.476421:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874741455508864:12345-0@lo:400: Request processed in 73us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892892.476444:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787892892.476462:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787892892.476469:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874741455508992:12345-0@lo:400: 00000100:00100000:0.0:1787892892.476499:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874741455508992:12345-0@lo:400: Request processed in 31us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892892.476505:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787892892.476516:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787892892.476522:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874741455509248:12345-0@lo:400: 00000100:00100000:0.0:1787892892.476554:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874741455509248:12345-0@lo:400: Request processed in 31us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892892.476560:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787892892.476583:0:6702:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1787892892.476593:0:6702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:0.0:1787892892.476613:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787892892.476824:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9070038c3800 x1874741455509248/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892892.476841:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874741455509248:0@lo:400: 00010000:00080000:0.0:1787892892.476867:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9070038c0380 x1874741455508992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892892.476876:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874741455508992:0@lo:400: 00010000:00080000:0.0:1787892892.476887:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9070038c2680 x1874741455508864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787892908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892892.476894:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874741455508864:0@lo:400: 00000100:00100000:0.0:1787892892.476925:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455509120 00000100:00100000:0.0:1787892892.476937:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455509120 00000100:00100000:0.0:1787892892.476963:0:6702:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1787892892.476970:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787892892.476976:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455509120:12345-0@lo:400: 00000100:00100000:0.0:1787892892.477014:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455509120:12345-0@lo:400: Request processed in 37us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892892.477020:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787892892.477047:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9070038c2300 x1874741455509120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892892.477055:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455509120:0@lo:400: 00000100:00100000:2.0:1787892892.478835:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+18:8102:x1874741455508736:12345-0@lo:502: Request processed in 10120us (10202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892892.478846:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787892892.478923:0:8102:0:(client.c:2715:ptlrpc_set_wait()) set ffff90712c4cc840 going to sleep for 11 seconds 00000100:00100000:2.0:1787892892.478945:0:8102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e81c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8102:1874741455508736:0@lo:502: 00000020:01000000:2.0:1787892892.478972:0:8102:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787892892.478977:0:8102:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787892892.478979:0:8102:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787892892.478982:0:8102:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1787892892.479510:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1787892892.479534:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787892892.479544:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9071013fca00/0x825e3f5022b4a613 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a61a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892892.479555:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9071013fca00/0x825e3f5022b4a613 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a61a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787892892.479566:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787892892.479568:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff907105a88000 from 1 10000000:01000000:0.0:1787892892.479571:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787892892.479624:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff907103f07000/0x825e3f5022b4a63d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892892.479632:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff907103f07000/0x825e3f5022b4a63d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892892.479642:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff907103f07000/0x825e3f5022b4a63d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892892.479673:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455509376:0@lo:101: 00000100:00100000:0.0:1787892892.479724:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892892.479796:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff907108643f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787892892.479797:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455509376 00000100:00100000:2.0:1787892892.479804:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455509376 00000100:00100000:2.0:1787892892.479840:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787892892.479851:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+18:5846:x1874741455509376:12345-0@lo:101: 00010000:00010000:2.0:1787892892.479906:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787892892.479917:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9071013fc800/0x825e3f5022b4a644 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4a63d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892892.479935:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9071013fc800/0x825e3f5022b4a644 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4a63d expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892892.479943:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9071013fc800/0x825e3f5022b4a644 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a63d expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892892.479949:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071013fc800, rc 0) 00000100:00100000:2.0:1787892892.479978:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+19:5846:x1874741455509376:12345-0@lo:101: Request processed in 128us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892892.479982:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787892892.480004:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455509376:0@lo:101: 00010000:00010000:2.0:1787892892.480012:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff907103f07000/0x825e3f5022b4a63d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a644 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892892.480018:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff907103f07000/0x825e3f5022b4a63d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a644 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892892.480051:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e81c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455509504:0@lo:501: 00000100:00100000:2.0:1787892892.480067:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892892.480081:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455509504 00000100:00100000:2.0:1787892892.480083:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455509504 00000100:00100000:2.0:1787892892.480095:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787892892.480099:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+19:5846:x1874741455509504:12345-0@lo:501: 00000100:00100000:2.0:1787892892.480345:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+19:5846:x1874741455509504:12345-0@lo:501: Request processed in 245us (276us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787892892.480350:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787892892.480365:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff90712c4cc000 going to sleep for 11 seconds 00000100:00100000:2.0:1787892892.480372:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e81c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455509504:0@lo:501: 10000000:01000000:2.0:1787892892.480384:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787892892.480387:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff907103f07000/0x825e3f5022b4a63d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a644 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892892.480392:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff907103f07000/0x825e3f5022b4a63d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a644 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892892.483295:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105afa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1874741455508608:12345-0@lo:8: Request processed in 14061us (14882us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892892.483310:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787892892.484164:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff907107e81180 x1874741455508608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787892902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892892.484179:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787892892.484189:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787892892.484199:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787892892.484205:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787892892.484208:0:3304:0:(import.c:65:import_set_state_nolock()) ffff907139bb2000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787892892.484269:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787892892.484276:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874741455508608:0@lo:8: 00000004:00080000:3.0:1787892892.484829:0:8103:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787892892.485042:0:8103:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 220252288890ns, next at 0ns, rc = 0 00000004:00080000:3.0:1787892892.560989:0:5870:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1787892892.561129:0:8104:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787892892.561146:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455509632:0@lo:13: 00000100:00100000:2.0:1787892892.561159:0:8104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e81f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8104:1874741455509760:0@lo:7: 00000100:00100000:2.0:1787892892.561683:0:8104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892892.561683:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892892.561801:0:8104:0:(client.c:2715:ptlrpc_set_wait()) set ffff90712c4cce40 going to sleep for 11 seconds 00000100:00100000:0.0:1787892892.561875:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455509760 00000100:00100000:0.0:1787892892.561883:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455509760 00000100:00100000:3.0:1787892892.561921:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455509632 00000100:00100000:3.0:1787892892.561927:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455509632 00000100:00100000:0.0:1787892892.561964:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787892892.561968:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787892892.561977:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107e80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8104:x1874741455509760:12345-0@lo:7: 00000100:00100000:3.0:1787892892.561980:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105af9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1874741455509632:12345-0@lo:13: 00002000:00000024:3.0:1787892892.562015:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1787892892.562067:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105af9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1874741455509632:12345-0@lo:13: Request processed in 90us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892892.562074:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787892892.562115:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff907107e81c00 x1874741455509632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892908 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892892.562133:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455509632:0@lo:13: 00000100:00080000:1.0:1787892892.562193:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:2.0:1787892892.574938:0:6702:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1787892892.574949:0:6702:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1787892892.575043:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107e80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8104:x1874741455509760:12345-0@lo:7: Request processed in 13065us (13363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892892.575054:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787892892.575310:0:8104:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff907107e81f80 x1874741455509760/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787892908 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892892.575328:0:8104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e81f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8104:1874741455509760:0@lo:7: 00000004:00080000:0.0:1787892892.575341:0:8104:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787892892.575380:0:8104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8104:1874741455509888:0@lo:5: 00000100:00100000:0.0:1787892892.575434:0:8104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892892.575473:0:8104:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071086439c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787892892.579044:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455509888 00000100:00100000:2.0:1787892892.579064:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455509888 00000100:00100000:2.0:1787892892.579143:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787892892.579155:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8104:x1874741455509888:12345-0@lo:5: 00002000:00080000:2.0:1787892892.579192:0:8105:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1787892892.579196:0:8105:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1787892892.580220:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:8104:x1874741455509888:12345-0@lo:5: Request processed in 1066us (4783us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787892892.580229:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787892892.580346:0:8104:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9070038c2680 x1874741455509888/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787892908 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892892.580364:0:8104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8104:1874741455509888:0@lo:5: 00000004:00080000:0.0:1787892892.580377:0:8104:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787892892.580843:0:8104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8104:1874741455510016:0@lo:700: 00000100:00100000:0.0:1787892892.580881:0:8104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892892.580918:0:8104:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071086439c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787892892.580981:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455510016 00000100:00100000:2.0:1787892892.580987:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455510016 00000100:00100000:2.0:1787892892.581066:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787892892.581076:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8104:x1874741455510016:12345-0@lo:700: 00000100:00100000:2.0:1787892892.581108:0:6708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e80700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6708:1874741455510144:0@lo:700: 00000100:00100000:2.0:1787892892.581144:0:6708:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892892.581174:0:6708:0:(client.c:2715:ptlrpc_set_wait()) set ffff90712c4cc3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787892892.581210:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455510144 00000100:00100000:3.0:1787892892.581216:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455510144 00000100:00100000:3.0:1787892892.581257:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787892892.581265:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107e82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6708:x1874741455510144:12345-0@lo:700: 40000000:02000000:3.0:1787892892.609312:0:5854:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1787892892.614097:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107e82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6708:x1874741455510144:12345-0@lo:700: Request processed in 32431us (32550us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892892.614113:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787892892.614214:0:6708:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff907107e80700 x1874741455510144/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787892908 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892892.614251:0:6708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e80700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6708:1874741455510144:0@lo:700: 40000000:02000000:0.0:1787892892.614267:0:6708:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:0.0:1787892892.708252:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1787892892.708278:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787892892.708499:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8104:x1874741455510016:12345-0@lo:700: Request processed in 127421us (127613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892892.708514:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787892892.708602:0:8104:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9070038c3800 x1874741455510016/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787892908 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892892.708614:0:8104:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787892892.708633:0:8104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8104:1874741455510016:0@lo:700: 00000004:02000040:0.0:1787892892.756802:0:8104:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1787892892.765102:0:8104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8104:1874741455510272:0@lo:5: 00000100:00100000:0.0:1787892892.765174:0:8104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892892.765257:0:8104:0:(client.c:2715:ptlrpc_set_wait()) set ffff907108643000 going to sleep for 11 seconds 00000100:00100000:2.0:1787892892.765359:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455510272 00000100:00100000:2.0:1787892892.765368:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455510272 00000100:00100000:2.0:1787892892.765422:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787892892.765432:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8104:x1874741455510272:12345-0@lo:5: 00010000:00010000:1.0:1787892892.769879:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1787892892.775555:0:6701:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1787892892.775584:0:6701:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1787892892.780658:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8104:x1874741455510272:12345-0@lo:5: Request processed in 15219us (15475us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787892892.780674:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787892892.780960:0:8104:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9070038c3800 x1874741455510272/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787892908 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892892.780979:0:8104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8104:1874741455510272:0@lo:5: 00000004:00080000:3.0:1787892892.780995:0:8104:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1787892893.777944:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787892894.810779:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787892895.003630:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:0.0:1787892895.602071:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787892895.602260:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431369856 00000100:00100000:1.0:1787892895.602270:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431369856 00000100:00100000:1.0:1787892895.602327:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 110 00000100:00100000:1.0:1787892895.602335:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2359:x1874741431369856:12345-192.168.202.29@tcp:250: 00010000:00080000:1.0:1787892895.602362:0:5841:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 18703558-96be-475d-879f-15397926f758@192.168.202.29@tcp t0 exp 0000000000000000 cur 223 last 0 00000020:00000080:1.0:1787892895.602391:0:5841:0:(genops.c:1385:class_connect()) connect: client 18703558-96be-475d-879f-15397926f758, cookie 0x825e3f5022b4a64b 00000100:00080000:1.0:1787892895.602523:0:5841:0:(import.c:65:import_set_state_nolock()) ffff9071075ba000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787892895.602879:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+5:2359:x1874741431369856:12345-192.168.202.29@tcp:250: Request processed in 541us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892895.602889:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 110 00000100:00100000:3.0:1787892895.637207:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787892895.650569:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431369984 00000100:00100000:2.0:1787892895.650603:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431369984 00000100:00100000:3.0:1787892895.661534:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 111 00000100:00100000:3.0:1787892895.661550:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+5:5589:x1874741431369984:12345-192.168.202.29@tcp:101: 00010000:00010000:3.0:1787892895.661568:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787892895.661663:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90710153a200/0x825e3f5022b4a652 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821ad8f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892895.661984:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90710153a200/0x825e3f5022b4a652 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ad8f expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892895.661997:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90710153a200/0x825e3f5022b4a652 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ad8f expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892895.662008:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90710153a200, rc 0) 00000100:00100000:3.0:1787892895.662085:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+6:5589:x1874741431369984:12345-192.168.202.29@tcp:101: Request processed in 539us (24888us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892895.662093:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 111 00000100:00100000:3.0:1787892895.674666:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787892895.675459:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431370112 00000100:00100000:0.0:1787892895.675470:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431370112 00000100:00100000:0.0:1787892895.675523:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 112 00000100:00100000:0.0:1787892895.675533:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+6:5589:x1874741431370112:12345-192.168.202.29@tcp:501: 00000100:00100000:0.0:1787892895.676007:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+6:5589:x1874741431370112:12345-192.168.202.29@tcp:501: Request processed in 474us (1350us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787892895.676025:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 112 00000100:00100000:0.0:1787892895.680459:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892895.680550:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431370240 00000100:00100000:3.0:1787892895.680561:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431370240 00000100:00100000:3.0:1787892895.680631:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 113 00000100:00100000:3.0:1787892895.680643:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+6:5589:x1874741431370240:12345-192.168.202.29@tcp:101: 00010000:00010000:3.0:1787892895.680661:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787892895.680679:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90710153ac00/0x825e3f5022b4a659 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821ad96 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892895.680718:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90710153ac00/0x825e3f5022b4a659 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ad96 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892895.680727:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90710153ac00/0x825e3f5022b4a659 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ad96 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892895.680737:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90710153ac00, rc 0) 00000100:00100000:2.0:1787892895.682901:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+7:5589:x1874741431370240:12345-192.168.202.29@tcp:101: Request processed in 2248us (2441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892895.682912:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 113 00000100:00100000:3.0:1787892895.687064:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787892895.690325:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431370368 00000100:00100000:2.0:1787892895.690347:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431370368 00000100:00100000:2.0:1787892895.690424:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 114 00000100:00100000:2.0:1787892895.690451:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+7:5589:x1874741431370368:12345-192.168.202.29@tcp:501: 00000100:00100000:2.0:1787892895.691192:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+8:5589:x1874741431370368:12345-192.168.202.29@tcp:501: Request processed in 737us (4134us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892895.691215:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 114 00000100:00100000:3.0:1787892895.694410:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787892895.694474:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431370496 00000100:00100000:2.0:1787892895.694484:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431370496 00000100:00100000:2.0:1787892895.694548:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 115 00000100:00100000:2.0:1787892895.694560:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+8:5589:x1874741431370496:12345-192.168.202.29@tcp:503: 00000100:00100000:2.0:1787892895.694895:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+8:5589:x1874741431370496:12345-192.168.202.29@tcp:503: Request processed in 336us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892895.694904:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 115 00000100:00100000:1.0:1787892895.698554:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787892895.698802:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431370624 00000100:00100000:2.0:1787892895.698813:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431370624 00000100:00100000:2.0:1787892895.698864:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 116 00000100:00100000:2.0:1787892895.698876:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+8:5607:x1874741431370624:12345-192.168.202.29@tcp:502: 00000100:00100000:2.0:1787892895.699204:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+8:5607:x1874741431370624:12345-192.168.202.29@tcp:502: Request processed in 325us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892895.699213:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 116 00000100:00100000:0.0:1787892895.734649:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892895.735563:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431370752 00000100:00100000:3.0:1787892895.735576:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431370752 00000100:00100000:3.0:1787892895.735641:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 117 00000100:00100000:3.0:1787892895.735652:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+8:5607:x1874741431370752:12345-192.168.202.29@tcp:502: 00000100:00100000:3.0:1787892895.736168:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+8:5607:x1874741431370752:12345-192.168.202.29@tcp:502: Request processed in 514us (1526us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892895.736177:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 117 00000100:00100000:3.0:1787892895.739696:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892895.739746:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431370880 00000100:00100000:3.0:1787892895.739780:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431370880 00000100:00100000:3.0:1787892895.739830:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 118 00000100:00100000:3.0:1787892895.739840:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+8:5589:x1874741431370880:12345-192.168.202.29@tcp:101: 00010000:00010000:3.0:1787892895.739856:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787892895.739873:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90710153aa00/0x825e3f5022b4a660 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821adc0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892895.739899:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90710153aa00/0x825e3f5022b4a660 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821adc0 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892895.739910:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90710153aa00/0x825e3f5022b4a660 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821adc0 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892895.739920:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90710153aa00, rc 0) 00000100:00100000:3.0:1787892895.739973:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+9:5589:x1874741431370880:12345-192.168.202.29@tcp:101: Request processed in 134us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892895.739979:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 118 00000100:00100000:1.0:1787892895.763605:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787892895.763789:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431371008 00000100:00100000:2.0:1787892895.763802:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431371008 00000100:00100000:2.0:1787892895.763894:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 119 00000100:00100000:2.0:1787892895.763904:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+9:5589:x1874741431371008:12345-192.168.202.29@tcp:256: 20000000:01000000:2.0:1787892895.763929:0:5843:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787892895.763952:0:5843:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787892895.763956:0:5843:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787892895.763959:0:5843:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787892895.763966:0:5843:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1787892895.768197:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+9:5589:x1874741431371008:12345-192.168.202.29@tcp:256: Request processed in 4283us (4591us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892895.768212:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 119 00000100:00100000:1.0:1787892895.774540:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892895.776229:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431371136 00000100:00100000:3.0:1787892895.776243:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431371136 00000100:00100000:3.0:1787892895.776301:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 120 00000100:00100000:3.0:1787892895.776311:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+9:5589:x1874741431371136:12345-192.168.202.29@tcp:101: 00010000:00010000:3.0:1787892895.776328:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787892895.776345:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90710153b000/0x825e3f5022b4a667 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821adc7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892895.776372:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90710153b000/0x825e3f5022b4a667 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821adc7 expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892895.776384:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90710153b000/0x825e3f5022b4a667 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821adc7 expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892895.776394:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90710153b000, rc 0) 00000100:00100000:3.0:1787892895.776458:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+10:5589:x1874741431371136:12345-192.168.202.29@tcp:101: Request processed in 148us (1929us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892895.776466:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 120 00000100:00100000:0.0:1787892895.779426:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787892895.779468:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431371264 00000100:00100000:0.0:1787892895.779481:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431371264 00000100:00100000:0.0:1787892895.779542:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 121 00000100:00100000:0.0:1787892895.779553:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907113ea9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+10:5589:x1874741431371264:12345-192.168.202.29@tcp:501: 00000100:00100000:0.0:1787892895.779881:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907113ea9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+10:5589:x1874741431371264:12345-192.168.202.29@tcp:501: Request processed in 329us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892895.779889:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 121 00000100:00100000:0.0:1787892895.786129:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892895.786306:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431371392 00000100:00100000:3.0:1787892895.786322:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431371392 00000100:00100000:3.0:1787892895.788362:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 122 00000100:00100000:3.0:1787892895.788388:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907119795450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+10:5589:x1874741431371392:12345-192.168.202.29@tcp:503: 00000100:00100000:3.0:1787892895.788822:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907119795450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+10:5589:x1874741431371392:12345-192.168.202.29@tcp:503: Request processed in 444us (2707us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892895.788831:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 122 00000100:00100000:1.0:1787892895.798177:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787892895.799582:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431371520 00000100:00100000:0.0:1787892895.799595:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431371520 00000100:00100000:0.0:1787892895.799825:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 123 00000100:00100000:0.0:1787892895.799838:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907119795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+10:5611:x1874741431371520:12345-192.168.202.29@tcp:502: 00000100:00100000:0.0:1787892895.800106:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907119795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+10:5611:x1874741431371520:12345-192.168.202.29@tcp:502: Request processed in 270us (1940us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892895.800114:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 123 00000100:00100000:1.0:1787892895.811943:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892895.815276:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431371648 00000100:00100000:3.0:1787892895.815290:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431371648 00000100:00100000:3.0:1787892895.815557:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 124 00000100:00100000:3.0:1787892895.815591:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907119794050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+10:5611:x1874741431371648:12345-192.168.202.29@tcp:502: 00000100:00100000:3.0:1787892895.815894:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907119794050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+10:5611:x1874741431371648:12345-192.168.202.29@tcp:502: Request processed in 306us (3961us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892895.815902:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 124 00010000:00010000:1.0:1787892895.816886:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787892895.823190:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787892895.823297:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431371776 00000100:00100000:2.0:1787892895.823310:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431371776 00000100:00100000:2.0:1787892895.823367:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 4 00000100:00100000:2.0:1787892895.823377:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105af9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2359:x1874741431371776:12345-192.168.202.29@tcp:38: 00010000:00080000:2.0:1787892895.823411:0:5847:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 4829748d-dde1-497a-9623-0e4326f0972c@192.168.202.29@tcp t0 exp 0000000000000000 cur 223 last 0 00000020:00000080:2.0:1787892895.823463:0:5847:0:(genops.c:1385:class_connect()) connect: client 4829748d-dde1-497a-9623-0e4326f0972c, cookie 0x825e3f5022b4a66e 00000004:00100000:2.0:1787892895.823506:0:5847:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1787892895.823513:0:5847:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1787892895.876161:0:5847:0:(import.c:65:import_set_state_nolock()) ffff907139ca8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787892895.876261:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105af9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+6:2359:x1874741431371776:12345-192.168.202.29@tcp:38: Request processed in 52882us (53080us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892895.876272:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 4 00000100:00100000:1.0:1787892896.458629:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787892896.458657:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455510400:0@lo:13: 00000100:00100000:1.0:1787892896.458734:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892896.458890:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455510400 00000100:00100000:3.0:1787892896.458900:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455510400 00000100:00100000:3.0:1787892896.459254:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787892896.459267:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105af8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455510400:12345-0@lo:13: 00002000:00000024:3.0:1787892896.459305:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787892896.459364:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105af8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455510400:12345-0@lo:13: Request processed in 101us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892896.459371:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787892896.459574:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90712ebbfb80 x1874741455510400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892912 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892896.459604:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455510400:0@lo:13: 00000100:00080000:2.0:1787892896.464124:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787892896.841735:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787892896.884329:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787892896.884402:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787892896.884494:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431371904 00000100:00100000:0.0:1787892896.884505:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431371904 00000100:00100000:0.0:1787892896.884582:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431372032 00000100:00100000:0.0:1787892896.884586:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431372032 00000100:00100000:0.0:1787892896.884606:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 5 00000100:00100000:0.0:1787892896.884632:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105afad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+7:0:x1874741431371904:12345-192.168.202.29@tcp:41: 00000004:00000024:0.0:1787892896.884683:0:5849:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787892896.884844:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105afad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+7:0:x1874741431371904:12345-192.168.202.29@tcp:41: Request processed in 214us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892896.884853:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 5 00000100:00100000:0.0:1787892896.884872:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 6 00000100:00100000:0.0:1787892896.884879:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105af9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+6:5589:x1874741431372032:12345-192.168.202.29@tcp:41: 00000004:00000024:0.0:1787892896.884890:0:5849:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787892896.884913:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105af9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+6:5589:x1874741431372032:12345-192.168.202.29@tcp:41: Request processed in 35us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892896.884920:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 6 00000100:00080000:1.0:1787892896.885951:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787892896.899480:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787892896.899642:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431372160 00000100:00100000:0.0:1787892896.899653:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431372160 00000100:00100000:0.0:1787892896.899730:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 7 00000100:00100000:0.0:1787892896.899742:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105af8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+6:5589:x1874741431372160:12345-192.168.202.29@tcp:40: 00000100:00100000:0.0:1787892896.899858:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105af8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+6:5589:x1874741431372160:12345-192.168.202.29@tcp:40: Request processed in 118us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892896.899866:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 7 00000100:00100000:1.0:1787892896.904851:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787892896.904897:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787892896.904927:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892896.905081:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431372288 00000100:00100000:3.0:1787892896.905090:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431372288 00000100:00100000:3.0:1787892896.905127:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431372416 00000100:00100000:3.0:1787892896.905129:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431372416 00000100:00100000:3.0:1787892896.905141:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 8 00000100:00100000:3.0:1787892896.905147:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105afb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2359:x1874741431372288:12345-192.168.202.29@tcp:8: 00010000:00080000:3.0:1787892896.905173:0:6700:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 4829748d-dde1-497a-9623-0e4326f0972c@192.168.202.29@tcp t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:3.0:1787892896.905198:0:6700:0:(genops.c:1385:class_connect()) connect: client 4829748d-dde1-497a-9623-0e4326f0972c, cookie 0x825e3f5022b4a675 00002000:00100000:3.0:1787892896.905209:0:6700:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4829748d-dde1-497a-9623-0e4326f0972c/ffff907139bb3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787892896.905220:0:6700:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787892896.905518:0:6700:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787892896.905542:0:6700:0:(import.c:65:import_set_state_nolock()) ffff907139bb5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787892896.905600:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105afb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4829748d-dde1-497a-9623-0e4326f0972c+6:2359:x1874741431372288:12345-192.168.202.29@tcp:8: Request processed in 452us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892896.905619:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 8 00000100:00100000:3.0:1787892896.905633:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 9 00000100:00100000:3.0:1787892896.905636:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105afb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2359:x1874741431372416:12345-192.168.202.29@tcp:8: 00010000:00080000:3.0:1787892896.905649:0:6700:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 4829748d-dde1-497a-9623-0e4326f0972c@192.168.202.29@tcp t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:3.0:1787892896.905664:0:6700:0:(genops.c:1385:class_connect()) connect: client 4829748d-dde1-497a-9623-0e4326f0972c, cookie 0x825e3f5022b4a67c 00002000:00100000:3.0:1787892896.905668:0:6700:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4829748d-dde1-497a-9623-0e4326f0972c/ffff907139bb0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787892896.905683:0:6700:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787892896.906182:0:6700:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787892896.906197:0:6700:0:(import.c:65:import_set_state_nolock()) ffff907139bb6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787892896.906221:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105afb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4829748d-dde1-497a-9623-0e4326f0972c+6:2359:x1874741431372416:12345-192.168.202.29@tcp:8: Request processed in 582us (1324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892896.906228:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 9 00000100:00100000:0.0:1787892896.908982:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431372672 00000100:00100000:0.0:1787892896.908998:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431372672 00000100:00100000:0.0:1787892896.909078:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 125 00000100:00100000:0.0:1787892896.909090:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907106340050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+10:2363:x1874741431372672:12345-192.168.202.29@tcp:400: 00000100:00100000:0.0:1787892896.909164:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907106340050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+10:2363:x1874741431372672:12345-192.168.202.29@tcp:400: Request processed in 76us (4235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892896.909173:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 125 00000100:00100000:1.0:1787892896.911191:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892896.911305:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431372544 00000100:00100000:3.0:1787892896.911314:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431372544 00000100:00100000:3.0:1787892896.911459:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 0 00000100:00100000:3.0:1787892896.911468:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105afbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+6:5589:x1874741431372544:12345-192.168.202.29@tcp:33: 00000004:00080000:0.0:1787892896.924102:0:5850:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 12575us 00000004:00200000:0.0:1787892896.939625:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1787892896.939849:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105afbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+6:5589:x1874741431372544:12345-192.168.202.29@tcp:33: Request processed in 28376us (28666us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892896.939864:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 0 00000100:00100000:1.0:1787892897.230545:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787892897.237221:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431372800 00000100:00100000:2.0:1787892897.237251:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431372800 00000100:00100000:2.0:1787892897.237369:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 8 00000100:00100000:2.0:1787892897.237381:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+6:5628:x1874741431372800:12345-192.168.202.29@tcp:101: 00010000:00010000:2.0:1787892897.237408:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787892897.237668:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9400/0x825e3f5022b4a683 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821adf1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892897.237804:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4a68a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892897.237839:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4a68a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892897.237855:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4a68a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787892897.239659:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787892897.239839:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787892897.240000:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4a68a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892897.244933:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9400/0x825e3f5022b4a683 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821adf1 expref: 8 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892897.244963:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4a68a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821adf1 expref: 7 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892897.244985:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907105cffd00) 00010000:00010000:3.0:1787892897.244987:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787892897.244990:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071102b8e00, rc 0) 00000100:00100000:3.0:1787892897.245109:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+7:5628:x1874741431372800:12345-192.168.202.29@tcp:101: Request processed in 7728us (14572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892897.245117:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 8 00000100:00100000:1.0:1787892897.484830:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e62a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874741455510784:0@lo:400: 00000100:00100000:1.0:1787892897.484936:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892897.485017:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787892897.485024:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e62b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455510912:0@lo:400: 00000100:00100000:1.0:1787892897.485054:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892897.485382:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e629500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22d910cf-711e-44e0-9acf-212404ada550:3307:1874741455510528:0@lo:400: 00000100:00100000:0.0:1787892897.485417:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892897.485453:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e629c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874741455511040:0@lo:400: 00000100:00100000:0.0:1787892897.485476:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892897.485512:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787892897.485518:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e628380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874741455510656:0@lo:400: 00000100:00100000:0.0:1787892897.485543:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892897.485569:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e629f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455511168:0@lo:400: 00000100:00100000:0.0:1787892897.485589:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892897.485620:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455510912 00000100:00100000:0.0:1787892897.485628:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455510912 00000100:00100000:0.0:1787892897.485695:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455511168 00000100:00100000:0.0:1787892897.485699:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455511168 00000100:00100000:0.0:1787892897.485731:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787892897.485741:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e628700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455510912:12345-0@lo:400: 00000100:00100000:0.0:1787892897.485823:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e628700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455510912:12345-0@lo:400: Request processed in 83us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892897.485831:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787892897.485847:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787892897.485854:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455511168:12345-0@lo:400: 00000100:00100000:0.0:1787892897.485886:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455511168:12345-0@lo:400: Request processed in 32us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892897.485892:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1787892897.485911:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787892897.485957:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90712e629f80 x1874741455511168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892897.485968:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787892897.485983:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e629f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455511168:0@lo:400: 00010000:00080000:0.0:1787892897.486023:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90712e62b800 x1874741455510912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892897.486033:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e62b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455510912:0@lo:400: 00000100:00100000:0.0:1787892897.486052:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455510784 00000100:00100000:0.0:1787892897.486055:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455510784 00000100:00100000:0.0:1787892897.486079:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455511040 00000100:00100000:0.0:1787892897.486082:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455511040 00000100:00100000:0.0:1787892897.486093:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455510656 00000100:00100000:0.0:1787892897.486095:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455510656 00000100:00100000:0.0:1787892897.486110:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787892897.486116:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874741455510784:12345-0@lo:400: 00000100:00100000:0.0:1787892897.486151:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874741455510784:12345-0@lo:400: Request processed in 35us (1217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892897.486158:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787892897.486171:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787892897.486176:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874741455511040:12345-0@lo:400: 00000100:00100000:0.0:1787892897.486221:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874741455511040:12345-0@lo:400: Request processed in 45us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892897.486398:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787892897.486414:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787892897.486422:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874741455510656:12345-0@lo:400: 00000100:00100000:0.0:1787892897.486455:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874741455510656:12345-0@lo:400: Request processed in 35us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892897.486468:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1787892897.486485:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787892897.486506:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e628380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874741455510656:0@lo:400: 00000100:00100000:0.0:1787892897.486517:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e629c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874741455511040:0@lo:400: 00000100:00100000:0.0:1787892897.486540:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e62a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874741455510784:0@lo:400: 00000100:00100000:1.0:1787892897.489430:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455510528 00000100:00100000:1.0:1787892897.489446:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455510528 00000100:00100000:1.0:1787892897.489501:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787892897.489509:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907106341c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+19:3307:x1874741455510528:12345-0@lo:400: 00000100:00100000:1.0:1787892897.489597:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907106341c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+19:3307:x1874741455510528:12345-0@lo:400: Request processed in 89us (4178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892897.489604:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787892897.509563:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e629500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22d910cf-711e-44e0-9acf-212404ada550:3307:1874741455510528:0@lo:400: 00000001:00100000:2.0:1787892897.574112:0:6725:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4829748d-dde1-497a-9623-0e4326f0972c 00010000:00010000:0.0:1787892897.866576:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787892897.993385:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455511296:0@lo:13: 00000100:00100000:0.0:1787892897.993481:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892897.993623:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455511296 00000100:00100000:3.0:1787892897.993635:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455511296 00000100:00100000:3.0:1787892897.993711:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787892897.993721:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455511296:12345-0@lo:13: 00002000:00000024:3.0:1787892897.993744:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787892897.993829:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455511296:12345-0@lo:13: Request processed in 109us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892897.993836:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787892897.993942:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90712ebbea00 x1874741455511296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892913 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892897.993963:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455511296:0@lo:13: 00010000:00010000:1.0:1787892898.889070:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787892899.833537:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787892899.835935:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431372928 00000100:00100000:0.0:1787892899.835955:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431372928 00000100:00100000:0.0:1787892899.836355:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 9 00000100:00100000:0.0:1787892899.836367:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+7:5680:x1874741431372928:12345-192.168.202.29@tcp:41: 00000004:00000024:0.0:1787892899.836416:0:5849:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787892899.836637:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+7:5680:x1874741431372928:12345-192.168.202.29@tcp:41: Request processed in 271us (3114us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892899.836855:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 9 00000100:00080000:2.0:1787892899.837703:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787892899.843909:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892899.844001:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431373056 00000100:00100000:3.0:1787892899.844010:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431373056 00000100:00100000:3.0:1787892899.844076:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 8 00000100:00100000:3.0:1787892899.844086:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e62ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4829748d-dde1-497a-9623-0e4326f0972c+5:5680:x1874741431373056:12345-192.168.202.29@tcp:13: 00002000:00000024:3.0:1787892899.844124:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787892899.844185:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e62ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4829748d-dde1-497a-9623-0e4326f0972c+5:5680:x1874741431373056:12345-192.168.202.29@tcp:13: Request processed in 101us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892899.844192:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 8 00000100:00080000:2.0:1787892899.844823:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787892899.859027:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892899.859126:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431373184 00000100:00100000:3.0:1787892899.859138:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431373184 00000100:00080000:2.0:1787892899.859237:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787892899.859244:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 9 00000100:00100000:3.0:1787892899.859258:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e62b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4829748d-dde1-497a-9623-0e4326f0972c+6:5680:x1874741431373184:12345-192.168.202.29@tcp:13: 00002000:00000024:3.0:1787892899.859306:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787892899.859390:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e62b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4829748d-dde1-497a-9623-0e4326f0972c+6:5680:x1874741431373184:12345-192.168.202.29@tcp:13: Request processed in 134us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892899.859399:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 9 00010000:00010000:1.0:1787892899.916550:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787892900.936970:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787892901.178293:0:5870:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4829748d-dde1-497a-9623-0e4326f0972c 00000100:00100000:0.0:1787892901.582004:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787892901.582041:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455511424:0@lo:13: 00000100:00100000:0.0:1787892901.582155:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892901.582189:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455511424 00000100:00100000:3.0:1787892901.582199:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455511424 00000100:00100000:3.0:1787892901.582271:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787892901.582281:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455511424:12345-0@lo:13: 00002000:00000024:3.0:1787892901.582317:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787892901.582367:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455511424:12345-0@lo:13: Request processed in 88us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892901.582374:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1787892901.582396:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787892901.582425:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff907107e83100 x1874741455511424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892917 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892901.582445:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455511424:0@lo:13: 00000001:00100000:3.0:1787892901.646499:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4829748d-dde1-497a-9623-0e4326f0972c 00000100:00100000:1.0:1787892901.946745:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787892901.946826:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787892901.946864:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787892901.946894:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431373312 00000100:00100000:1.0:1787892901.946898:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787892901.946905:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431373312 00000100:00100000:1.0:1787892901.946928:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431373568 00000100:00100000:1.0:1787892901.946932:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431373568 00000100:00100000:0.0:1787892901.946958:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 127 00000100:00100000:0.0:1787892901.946967:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907106342050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+10:2362:x1874741431373312:12345-192.168.202.29@tcp:400: 00000100:00100000:1.0:1787892901.946970:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431373696 00000100:00100000:1.0:1787892901.946973:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431373696 00000100:00100000:1.0:1787892901.946991:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 6 00000100:00100000:1.0:1787892901.946997:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e628000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4829748d-dde1-497a-9623-0e4326f0972c+5:2362:x1874741431373568:12345-192.168.202.29@tcp:400: 00000100:00100000:3.0:1787892901.947071:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431373440 00000100:00100000:3.0:1787892901.947076:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431373440 00000100:00100000:3.0:1787892901.947112:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 22 00000100:00100000:3.0:1787892901.947120:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e62b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+6:2362:x1874741431373440:12345-192.168.202.29@tcp:400: 00000100:00100000:2.0:1787892901.947125:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 7 00000100:00100000:2.0:1787892901.947133:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e62bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4829748d-dde1-497a-9623-0e4326f0972c+5:2362:x1874741431373696:12345-192.168.202.29@tcp:400: 00000100:00100000:0.0:1787892901.947187:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907106342050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+10:2362:x1874741431373312:12345-192.168.202.29@tcp:400: Request processed in 220us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892901.947196:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 127 00000100:00080000:0.0:1787892901.947246:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787892901.947251:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787892901.947253:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787892901.955740:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e628000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4829748d-dde1-497a-9623-0e4326f0972c+5:2362:x1874741431373568:12345-192.168.202.29@tcp:400: Request processed in 8726us (8897us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892901.955772:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 6 00000100:00100000:3.0:1787892901.965589:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e62b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+6:2362:x1874741431373440:12345-192.168.202.29@tcp:400: Request processed in 18457us (18711us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892901.965606:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 22 00000100:00100000:2.0:1787892901.970833:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e62bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4829748d-dde1-497a-9623-0e4326f0972c+5:2362:x1874741431373696:12345-192.168.202.29@tcp:400: Request processed in 21078us (21311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892901.970851:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 7 00010000:00010000:1.0:1787892901.970982:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787892902.600893:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22d910cf-711e-44e0-9acf-212404ada550:3307:1874741455511552:0@lo:400: 00000100:00100000:2.0:1787892902.600980:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892902.601029:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e62a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874741455511680:0@lo:400: 00000100:00100000:2.0:1787892902.601034:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e629500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874741455512064:0@lo:400: 00000100:00100000:2.0:1787892902.601071:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892902.601162:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455511552 00000100:00100000:3.0:1787892902.601173:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e62aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874741455511808:0@lo:400: 00000100:00100000:2.0:1787892902.601175:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455511552 00000100:00100000:2.0:1787892902.601240:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787892902.601253:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+19:3307:x1874741455511552:12345-0@lo:400: 00000100:00100000:3.0:1787892902.601310:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892902.601322:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+19:3307:x1874741455511552:12345-0@lo:400: Request processed in 70us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892902.601339:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787892902.601395:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22d910cf-711e-44e0-9acf-212404ada550:3307:1874741455511552:0@lo:400: 00000100:00100000:2.0:1787892902.605089:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455511936:0@lo:400: 00000100:00100000:2.0:1787892902.605175:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892902.605495:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455511936 00000100:00100000:0.0:1787892902.605513:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455511936 00000100:00100000:0.0:1787892902.605598:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787892902.605617:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107e83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455511936:12345-0@lo:400: 00000100:00100000:0.0:1787892902.605732:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107e83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455511936:12345-0@lo:400: Request processed in 123us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892902.605740:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1787892902.606340:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90712e629180 x1874741455511936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892902.606353:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455511936:0@lo:400: 00000100:00100000:3.0:1787892902.606837:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892902.607023:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455512064 00000100:00100000:1.0:1787892902.607035:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455512064 00000100:00080000:2.0:1787892902.607119:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787892902.609810:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455511808 00000100:00100000:0.0:1787892902.609832:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455511808 00000100:00100000:0.0:1787892902.609927:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787892902.609945:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107e80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874741455512064:12345-0@lo:400: 00000100:00100000:0.0:1787892902.610083:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107e80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874741455512064:12345-0@lo:400: Request processed in 145us (9009us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892902.610233:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e62a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455512192:0@lo:400: 00000100:00080000:2.0:1787892902.611448:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787892902.612090:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e629500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874741455512064:0@lo:400: 00000100:00100000:3.0:1787892902.612347:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892902.613604:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787892902.613631:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874741455511808:12345-0@lo:400: 00000100:00100000:1.0:1787892902.613928:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874741455511808:12345-0@lo:400: Request processed in 310us (12620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892902.613938:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787892902.613975:0:5848:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787892902.613985:0:5848:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1787892902.614020:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455512192 00000100:00100000:3.0:1787892902.614027:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e62aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874741455511808:0@lo:400: 00000100:00100000:1.0:1787892902.614030:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455512192 00000100:00100000:1.0:1787892902.614102:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787892902.614114:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455512192:12345-0@lo:400: 00000100:00100000:1.0:1787892902.614160:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455512192:12345-0@lo:400: Request processed in 51us (1820us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892902.614175:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1787892902.614196:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787892902.614210:0:5847:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787892902.614216:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455511680 00000100:00100000:1.0:1787892902.614220:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455511680 00000100:00100000:1.0:1787892902.614243:0:5847:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787892902.614251:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787892902.614256:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874741455511680:12345-0@lo:400: 00000100:00100000:1.0:1787892902.614288:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874741455511680:12345-0@lo:400: Request processed in 32us (7456us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892902.614295:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787892902.614380:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787892902.614506:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e62a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874741455511680:0@lo:400: 00010000:00080000:3.0:1787892902.614525:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90712e62a300 x1874741455512192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892902.614536:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e62a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455512192:0@lo:400: 00000001:02000400:3.0:1787892902.971823:0:8309:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1787892902.985039:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787892903.113566:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787892903.113614:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455512320:0@lo:13: 00000100:00100000:3.0:1787892903.113709:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892903.113809:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455512320 00000100:00100000:3.0:1787892903.113820:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455512320 00000100:00100000:3.0:1787892903.113874:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787892903.113884:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455512320:12345-0@lo:13: 00002000:00000024:3.0:1787892903.113924:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787892903.113969:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455512320:12345-0@lo:13: Request processed in 84us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892903.113975:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1787892903.114033:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90712ebbe300 x1874741455512320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892919 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892903.114054:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455512320:0@lo:13: 00010000:00010000:0.0:1787892904.013174:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892905.032935:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892906.071749:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787892906.712241:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455512448:0@lo:13: 00000100:00100000:2.0:1787892906.712318:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892906.712407:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455512448 00000100:00100000:2.0:1787892906.712415:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455512448 00000100:00100000:2.0:1787892906.712474:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787892906.712487:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107e81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455512448:12345-0@lo:13: 00002000:00000024:2.0:1787892906.712530:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787892906.712578:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107e81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455512448:12345-0@lo:13: Request processed in 94us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892906.712586:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1787892906.712619:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787892906.712651:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff907107e80700 x1874741455512448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892922 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892906.712671:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455512448:0@lo:13: 00000100:00100000:1.0:1787892907.059837:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787892907.059880:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787892907.059917:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431373952 00000100:00100000:1.0:1787892907.059928:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431373952 00000100:00100000:1.0:1787892907.059999:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 26 00000100:00100000:1.0:1787892907.060011:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+6:2362:x1874741431373952:12345-192.168.202.29@tcp:400: 00000100:00100000:1.0:1787892907.060091:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+6:2362:x1874741431373952:12345-192.168.202.29@tcp:400: Request processed in 82us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892907.060099:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 26 00000100:00080000:1.0:1787892907.060124:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787892907.060380:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431373824 00000100:00100000:3.0:1787892907.060386:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431373824 00000100:00100000:3.0:1787892907.060417:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 129 00000100:00100000:3.0:1787892907.060423:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+10:2362:x1874741431373824:12345-192.168.202.29@tcp:400: 00000100:00100000:3.0:1787892907.060455:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+10:2362:x1874741431373824:12345-192.168.202.29@tcp:400: Request processed in 33us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892907.060462:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 129 00000100:00100000:3.0:1787892907.060512:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892907.060582:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892907.060612:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431374080 00000100:00100000:3.0:1787892907.060616:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431374080 00000100:00100000:3.0:1787892907.060648:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431374208 00000100:00100000:3.0:1787892907.060650:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431374208 00000100:00100000:3.0:1787892907.060670:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 10 00000100:00100000:3.0:1787892907.060677:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4829748d-dde1-497a-9623-0e4326f0972c+5:2362:x1874741431374080:12345-192.168.202.29@tcp:400: 00000100:00100000:3.0:1787892907.060708:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4829748d-dde1-497a-9623-0e4326f0972c+5:2362:x1874741431374080:12345-192.168.202.29@tcp:400: Request processed in 32us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892907.060714:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 10 00000100:00100000:3.0:1787892907.060726:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 11 00000100:00100000:3.0:1787892907.060731:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4829748d-dde1-497a-9623-0e4326f0972c+5:2362:x1874741431374208:12345-192.168.202.29@tcp:400: 00000100:00100000:3.0:1787892907.061803:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4829748d-dde1-497a-9623-0e4326f0972c+5:2362:x1874741431374208:12345-192.168.202.29@tcp:400: Request processed in 1063us (1213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892907.061813:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 11 00000100:00080000:3.0:1787892907.061848:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787892907.061852:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787892907.085077:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787892907.099194:0:8457:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff465ea480 20000000:00000080:3.0:1787892907.099214:0:8457:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff907139bccc00 uarg=0000000000000000 20000000:01000000:3.0:1787892907.099308:0:8457:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1787892907.099310:0:8457:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1787892907.099313:0:8457:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1787892907.099317:0:8457:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1787892907.099322:0:8457:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1787892907.099336:0:8457:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787892907.099339:0:8457:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787892907.099517:0:8457:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787892907.099520:0:8457:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787892907.101396:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1787892907.102079:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1787892907.102146:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1787892907.102185:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:3.0:1787892907.102198:0:8457:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787892907.102200:0:8457:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787892907.103291:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1787892907.105219:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1787892907.105275:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1787892907.105310:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:0.0:1787892907.105327:0:8457:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1787892907.105329:0:8457:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787892907.106359:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1787892907.107784:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1787892907.107867:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1787892907.107907:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1787892907.107923:0:8457:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787892907.107926:0:8457:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787892907.109286:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1787892907.110020:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1787892907.110073:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1787892907.110380:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 10000000:01000000:3.0:1787892907.110398:0:8457:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787892907.110418:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907104f47e00/0x825e3f5022b4a691 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892907.110437:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90710153b200/0x825e3f5022b4a58e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a587 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892907.110444:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9071421fbe00/0x825e3f5022b4a5b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a5b1 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892907.110563:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907100031e00/0x825e3f5022b4a5e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a5db expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892907.110581:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9071013fde00/0x825e3f5022b4a5f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a5e9 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892907.110588:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907100030800/0x825e3f5022b4a5fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a5f7 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892907.110594:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907100031400/0x825e3f5022b4a61a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a613 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892907.110611:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9071013fc800/0x825e3f5022b4a644 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a63d expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892907.110621:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90710153a200/0x825e3f5022b4a652 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ad8f expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892907.110628:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90710153ac00/0x825e3f5022b4a659 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ad96 expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892907.110636:0:8457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907104f47e00/0x825e3f5022b4a691 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892907.110676:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90710153ac00/0x825e3f5022b4a659 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ad96 expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892907.110692:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90710153ac00/0x825e3f5022b4a659 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ad96 expref: 9 pid: 5842 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892907.110709:0:8457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1874741455512576:192.168.202.29@tcp:104: 00010000:00010000:3.0:1787892907.112457:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90710153a200/0x825e3f5022b4a652 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ad8f expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892907.112486:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90710153a200/0x825e3f5022b4a652 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ad8f expref: 9 pid: 5842 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892907.112498:0:8457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1874741455512704:192.168.202.29@tcp:104: 00010000:00010000:3.0:1787892907.112544:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9071013fc800/0x825e3f5022b4a644 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x825e3f5022b4a63d expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892907.112553:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9071013fc800/0x825e3f5022b4a644 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x825e3f5022b4a63d expref: 18 pid: 5842 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892907.112562:0:8457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbe680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1874741455512832:0@lo:104: 00000100:00100000:3.0:1787892907.112623:0:8457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787892907.112696:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907100031400/0x825e3f5022b4a61a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x825e3f5022b4a613 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892907.112704:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907100031400/0x825e3f5022b4a61a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x825e3f5022b4a613 expref: 18 pid: 5842 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892907.112711:0:8457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1874741455512960:0@lo:104: 00000100:00100000:3.0:1787892907.112738:0:8457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787892907.113432:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907100030800/0x825e3f5022b4a5fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x825e3f5022b4a5f7 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892907.113443:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907100030800/0x825e3f5022b4a5fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x825e3f5022b4a5f7 expref: 18 pid: 5841 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892907.113466:0:8457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1874741455513088:0@lo:104: 00010000:00010000:3.0:1787892907.113612:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9071013fde00/0x825e3f5022b4a5f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x825e3f5022b4a5e9 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892907.113632:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9071013fde00/0x825e3f5022b4a5f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x825e3f5022b4a5e9 expref: 18 pid: 5842 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892907.113642:0:8457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1874741455513216:0@lo:104: 00010000:00010000:3.0:1787892907.113670:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907100031e00/0x825e3f5022b4a5e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x825e3f5022b4a5db expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892907.113679:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907100031e00/0x825e3f5022b4a5e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x825e3f5022b4a5db expref: 18 pid: 5842 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892907.113686:0:8457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1874741455513344:0@lo:104: 00010000:00010000:3.0:1787892907.113711:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9071421fbe00/0x825e3f5022b4a5b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x825e3f5022b4a5b1 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892907.113718:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9071421fbe00/0x825e3f5022b4a5b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x825e3f5022b4a5b1 expref: 18 pid: 5842 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892907.113725:0:8457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1874741455513472:0@lo:104: 00010000:00010000:3.0:1787892907.113746:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90710153b200/0x825e3f5022b4a58e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x825e3f5022b4a587 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892907.113771:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90710153b200/0x825e3f5022b4a58e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x825e3f5022b4a587 expref: 18 pid: 5842 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892907.113778:0:8457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1874741455513600:0@lo:104: 00000100:00100000:3.0:1787892907.113801:0:8457:0:(client.c:2715:ptlrpc_set_wait()) set ffff907139cde180 going to sleep for 11 seconds 00000100:00100000:0.0:1787892907.114030:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787892907.114055:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892907.114214:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892907.114237:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455512832 00000100:00100000:2.0:1787892907.114246:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455512832 00000100:00100000:2.0:1787892907.114289:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455512960 00000100:00100000:2.0:1787892907.114293:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455512960 00000100:00100000:2.0:1787892907.114303:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455513088 00000100:00100000:2.0:1787892907.114306:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455513088 00000100:00100000:2.0:1787892907.114319:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787892907.114327:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebbce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22d910cf-711e-44e0-9acf-212404ada550+5:8457:x1874741455512832:12345-0@lo:104: 00010000:00010000:2.0:1787892907.114339:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff907103f07000/0x825e3f5022b4a63d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a644 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.114444:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787892907.114460:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebbce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22d910cf-711e-44e0-9acf-212404ada550+5:8457:x1874741455512832:12345-0@lo:104: Request processed in 134us (1838us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892907.114466:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787892907.114482:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787892907.114488:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137c00850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22d910cf-711e-44e0-9acf-212404ada550+4:8457:x1874741455512960:12345-0@lo:104: 00010000:00010000:2.0:1787892907.114497:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9071013fca00/0x825e3f5022b4a613 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a61a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892907.114572:0:8457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbe680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1874741455512832:0@lo:104: 00000100:00100000:3.0:1787892907.114586:0:8457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1874741455512960:0@lo:104: 00010000:00010000:1.0:1787892907.114889:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787892907.114897:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff907103f07000/0x825e3f5022b4a63d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a644 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892907.114904:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907103f07000 already unused, calling callback (ffffffffc1c05c20) 10000000:00010000:1.0:1787892907.114912:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff907103f07000/0x825e3f5022b4a63d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x825e3f5022b4a644 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892907.114921:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff907103f07000/0x825e3f5022b4a63d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x825e3f5022b4a644 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787892907.114928:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff907103f07000/0x825e3f5022b4a63d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x825e3f5022b4a644 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787892907.114933:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787892907.114973:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff907103f07000/0x825e3f5022b4a63d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a644 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892907.114980:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787892907.115000:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff907103f07000/0x825e3f5022b4a63d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a644 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892907.115008:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff907103f07000/0x825e3f5022b4a63d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a644 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892907.115020:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787892907.115023:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9071013fca00/0x825e3f5022b4a613 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a61a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892907.115029:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071013fca00 already unused, calling callback (ffffffffc1c05c20) 10000000:00010000:1.0:1787892907.115032:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9071013fca00/0x825e3f5022b4a613 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x825e3f5022b4a61a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892907.115040:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9071013fca00/0x825e3f5022b4a613 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x825e3f5022b4a61a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787892907.115057:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9071013fca00/0x825e3f5022b4a613 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x825e3f5022b4a61a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787892907.115062:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787892907.115075:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9071013fca00/0x825e3f5022b4a613 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a61a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892907.115081:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787892907.115086:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9071013fca00/0x825e3f5022b4a613 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a61a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892907.115092:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9071013fca00/0x825e3f5022b4a613 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a61a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892907.115102:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892907.115104:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892907.115106:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787892907.115119:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e628380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22d910cf-711e-44e0-9acf-212404ada550:3307:1874741455513728:0@lo:103: 00000100:00100000:1.0:1787892907.115151:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892907.115182:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787892907.115188:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e62b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22d910cf-711e-44e0-9acf-212404ada550:3307:1874741455513856:0@lo:103: 00000100:00100000:1.0:1787892907.115208:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892907.115238:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455513728 00000100:00100000:1.0:1787892907.115242:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455513728 00010000:00010000:1.0:1787892907.115263:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9071013fc800/0x825e3f5022b4a644 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a63d expref: 19 pid: 5842 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892907.115283:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455513856 00000100:00100000:1.0:1787892907.115287:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455513856 00010000:00010000:1.0:1787892907.115305:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907100031400/0x825e3f5022b4a61a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a613 expref: 20 pid: 5842 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892907.115320:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787892907.115326:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e629f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22d910cf-711e-44e0-9acf-212404ada550+20:3307:x1874741455513728:12345-0@lo:103: 00010000:00010000:1.0:1787892907.115337:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787892907.115343:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9071013fc800/0x825e3f5022b4a644 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a63d expref: 20 pid: 5842 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892907.115352:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9071013fc800/0x825e3f5022b4a644 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x825e3f5022b4a63d expref: 20 pid: 5842 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892907.115365:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9071013fc800/0x825e3f5022b4a644 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x825e3f5022b4a63d expref: 20 pid: 5842 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892907.115376:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787892907.115405:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e629f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22d910cf-711e-44e0-9acf-212404ada550+19:3307:x1874741455513728:12345-0@lo:103: Request processed in 79us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892907.115411:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787892907.115428:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787892907.115434:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e62a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22d910cf-711e-44e0-9acf-212404ada550+18:3307:x1874741455513856:12345-0@lo:103: 00010000:00010000:1.0:1787892907.115440:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787892907.115445:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907100031400/0x825e3f5022b4a61a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a613 expref: 18 pid: 5842 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892907.115452:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907100031400/0x825e3f5022b4a61a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x825e3f5022b4a613 expref: 18 pid: 5842 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892907.115462:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907100031400/0x825e3f5022b4a61a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x825e3f5022b4a613 expref: 18 pid: 5842 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892907.115482:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787892907.115505:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e62a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22d910cf-711e-44e0-9acf-212404ada550+17:3307:x1874741455513856:12345-0@lo:103: Request processed in 71us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892907.115510:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787892907.115545:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e62b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22d910cf-711e-44e0-9acf-212404ada550:3307:1874741455513856:0@lo:103: 00000100:00100000:1.0:1787892907.115553:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e628380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22d910cf-711e-44e0-9acf-212404ada550:3307:1874741455513728:0@lo:103: 00000100:00100000:0.0:1787892907.115777:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892907.115789:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892907.115799:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892907.115808:0:5831:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1787892907.116153:0:8457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1874741455512576:192.168.202.29@tcp:104: 00000100:00100000:0.0:1787892907.116163:0:8457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1874741455512704:192.168.202.29@tcp:104: 00000100:00100000:1.0:1787892907.116216:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:1.0:1787892907.116445:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455513216 00000100:00100000:1.0:1787892907.116450:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455513216 00000100:00100000:1.0:1787892907.116476:0:5831:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1787892907.116482:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455513344 00000100:00100000:1.0:1787892907.116485:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455513344 00000100:00100000:1.0:1787892907.116493:0:5831:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1787892907.116497:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455513472 00000100:00100000:1.0:1787892907.116498:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455513472 00000100:00100000:1.0:1787892907.116505:0:5831:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1787892907.116509:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455513600 00000100:00100000:1.0:1787892907.116511:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455513600 00010000:00010000:1.0:1787892907.118249:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787892907.119845:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787892907.119885:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431374336 00000100:00100000:1.0:1787892907.119895:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431374336 00010000:00010000:1.0:1787892907.119931:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90710153ac00/0x825e3f5022b4a659 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ad96 expref: 10 pid: 5842 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892907.119964:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 14 00000100:00100000:1.0:1787892907.119973:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e628380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:18703558-96be-475d-879f-15397926f758+10:2360:x1874741431374336:12345-192.168.202.29@tcp:103: 00010000:00010000:1.0:1787892907.119987:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787892907.120005:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90710153ac00/0x825e3f5022b4a659 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ad96 expref: 10 pid: 5842 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892907.120017:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90710153ac00/0x825e3f5022b4a659 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ad96 expref: 10 pid: 5842 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892907.120034:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90710153ac00/0x825e3f5022b4a659 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ad96 expref: 10 pid: 5842 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892907.120052:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787892907.120099:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e628380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:18703558-96be-475d-879f-15397926f758+9:2360:x1874741431374336:12345-192.168.202.29@tcp:103: Request processed in 127us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892907.120107:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 14 00010000:00010000:2.0:1787892907.120265:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1787892907.120276:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137c00850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22d910cf-711e-44e0-9acf-212404ada550+8:8457:x1874741455512960:12345-0@lo:104: Request processed in 5785us (7535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892907.120284:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787892907.120340:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787892907.120349:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22d910cf-711e-44e0-9acf-212404ada550+7:8457:x1874741455513088:12345-0@lo:104: 00010000:00010000:2.0:1787892907.120368:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff90710153be00/0x825e3f5022b4a5f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a5fe expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.120431:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787892907.120437:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22d910cf-711e-44e0-9acf-212404ada550+7:8457:x1874741455513088:12345-0@lo:104: Request processed in 91us (6381us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892907.120443:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787892907.120467:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787892907.120475:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22d910cf-711e-44e0-9acf-212404ada550+6:8457:x1874741455513216:12345-0@lo:104: 00010000:00010000:2.0:1787892907.120482:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff907100031800/0x825e3f5022b4a5e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a5f0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.120518:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787892907.120523:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22d910cf-711e-44e0-9acf-212404ada550+6:8457:x1874741455513216:12345-0@lo:104: Request processed in 49us (6309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892907.120529:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787892907.120544:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787892907.120551:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22d910cf-711e-44e0-9acf-212404ada550+5:8457:x1874741455513344:12345-0@lo:104: 00010000:00010000:2.0:1787892907.120558:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9071013fcc00/0x825e3f5022b4a5db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a5e2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.121489:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787892907.121498:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22d910cf-711e-44e0-9acf-212404ada550+5:8457:x1874741455513344:12345-0@lo:104: Request processed in 947us (5720us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892907.121505:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787892907.121525:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787892907.121533:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22d910cf-711e-44e0-9acf-212404ada550+4:8457:x1874741455513472:12345-0@lo:104: 00010000:00010000:2.0:1787892907.121551:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff90710153ba00/0x825e3f5022b4a5b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a5b8 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.121655:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787892907.121661:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22d910cf-711e-44e0-9acf-212404ada550+4:8457:x1874741455513472:12345-0@lo:104: Request processed in 130us (5870us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892907.121667:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787892907.121681:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787892907.121688:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22d910cf-711e-44e0-9acf-212404ada550+3:8457:x1874741455513600:12345-0@lo:104: 00010000:00010000:2.0:1787892907.121695:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff907100031000/0x825e3f5022b4a587 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a58e expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.121722:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1787892907.121726:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22d910cf-711e-44e0-9acf-212404ada550+3:8457:x1874741455513600:12345-0@lo:104: Request processed in 40us (5927us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892907.121732:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1787892907.121769:0:7644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1787892907.121775:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff90710153be00/0x825e3f5022b4a5f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a5fe expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.121783:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153be00 already unused, calling callback (ffffffffc1c05c20) 10000000:00010000:2.0:1787892907.121787:0:7644:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff90710153be00/0x825e3f5022b4a5f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x825e3f5022b4a5fe expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.121796:0:7644:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff90710153be00/0x825e3f5022b4a5f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x825e3f5022b4a5fe expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787892907.121803:0:7644:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff90710153be00/0x825e3f5022b4a5f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x825e3f5022b4a5fe expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892907.121815:0:7644:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787892907.121853:0:7644:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff90710153be00/0x825e3f5022b4a5f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a5fe expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.121859:0:7644:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787892907.121877:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff90710153be00/0x825e3f5022b4a5f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a5fe expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.121884:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff90710153be00/0x825e3f5022b4a5f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a5fe expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.121897:0:7644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787892907.121900:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff907100031800/0x825e3f5022b4a5e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a5f0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.121905:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907100031800 already unused, calling callback (ffffffffc1c05c20) 10000000:00010000:2.0:1787892907.121908:0:7644:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff907100031800/0x825e3f5022b4a5e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x825e3f5022b4a5f0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.121914:0:7644:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff907100031800/0x825e3f5022b4a5e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x825e3f5022b4a5f0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787892907.121919:0:7644:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff907100031800/0x825e3f5022b4a5e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x825e3f5022b4a5f0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892907.121924:0:7644:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787892907.121935:0:7644:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff907100031800/0x825e3f5022b4a5e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a5f0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.121940:0:7644:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787892907.121951:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff907100031800/0x825e3f5022b4a5e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a5f0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.121957:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff907100031800/0x825e3f5022b4a5e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a5f0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.121967:0:7644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787892907.121970:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9071013fcc00/0x825e3f5022b4a5db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a5e2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.121976:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071013fcc00 already unused, calling callback (ffffffffc1c05c20) 10000000:00010000:2.0:1787892907.121979:0:7644:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9071013fcc00/0x825e3f5022b4a5db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x825e3f5022b4a5e2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.121985:0:7644:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9071013fcc00/0x825e3f5022b4a5db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x825e3f5022b4a5e2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787892907.121991:0:7644:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9071013fcc00/0x825e3f5022b4a5db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x825e3f5022b4a5e2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892907.121997:0:7644:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787892907.122009:0:7644:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9071013fcc00/0x825e3f5022b4a5db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a5e2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.122014:0:7644:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787892907.122033:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9071013fcc00/0x825e3f5022b4a5db lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a5e2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.122039:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9071013fcc00/0x825e3f5022b4a5db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a5e2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.122047:0:7644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787892907.122055:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff90710153ba00/0x825e3f5022b4a5b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a5b8 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.122062:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153ba00 already unused, calling callback (ffffffffc1c05c20) 10000000:00010000:2.0:1787892907.122065:0:7644:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff90710153ba00/0x825e3f5022b4a5b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x825e3f5022b4a5b8 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.122072:0:7644:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff90710153ba00/0x825e3f5022b4a5b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x825e3f5022b4a5b8 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787892907.122077:0:7644:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff90710153ba00/0x825e3f5022b4a5b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x825e3f5022b4a5b8 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892907.122081:0:7644:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787892907.122094:0:7644:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff90710153ba00/0x825e3f5022b4a5b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a5b8 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.122100:0:7644:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787892907.122105:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff90710153ba00/0x825e3f5022b4a5b1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a5b8 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.122111:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff90710153ba00/0x825e3f5022b4a5b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a5b8 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.122118:0:7644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787892907.122120:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff907100031000/0x825e3f5022b4a587 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a58e expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.122126:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907100031000 already unused, calling callback (ffffffffc1c05c20) 10000000:00010000:2.0:1787892907.122129:0:7644:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff907100031000/0x825e3f5022b4a587 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x825e3f5022b4a58e expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.122144:0:7644:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff907100031000/0x825e3f5022b4a587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x825e3f5022b4a58e expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787892907.122151:0:7644:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff907100031000/0x825e3f5022b4a587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x825e3f5022b4a58e expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892907.122156:0:7644:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787892907.122168:0:7644:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff907100031000/0x825e3f5022b4a587 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a58e expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.122173:0:7644:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787892907.122177:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff907100031000/0x825e3f5022b4a587 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a58e expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.122184:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff907100031000/0x825e3f5022b4a587 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a58e expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.122197:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892907.122216:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892907.122218:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892907.122224:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787892907.122238:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455513984:0@lo:103: 00000100:00100000:2.0:1787892907.122289:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892907.122322:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455514496:0@lo:103: 00000100:00100000:2.0:1787892907.122342:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892907.122361:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787892907.122367:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455514112:0@lo:103: 00000100:00100000:2.0:1787892907.122385:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892907.122515:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455513984 00000100:00100000:2.0:1787892907.122523:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455513984 00010000:00010000:2.0:1787892907.122548:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907100030800/0x825e3f5022b4a5fe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a5f7 expref: 17 pid: 5841 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892907.122566:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455514496 00000100:00100000:2.0:1787892907.122569:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455514496 00000100:00100000:1.0:1787892907.124156:0:8457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1874741455513088:0@lo:104: 00000100:00100000:1.0:1787892907.124173:0:8457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1874741455513216:0@lo:104: 00000100:00100000:1.0:1787892907.124181:0:8457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1874741455513344:0@lo:104: 00000100:00100000:1.0:1787892907.124190:0:8457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1874741455513472:0@lo:104: 00000100:00100000:1.0:1787892907.124198:0:8457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1874741455513600:0@lo:104: 00010000:00010000:1.0:1787892907.124240:0:8457:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907104f47e00/0x825e3f5022b4a691 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892907.124748:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892907.124855:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22d910cf-711e-44e0-9acf-212404ada550:3308:1874741455514368:0@lo:103: 00000100:00100000:3.0:1787892907.124899:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892907.124934:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787892907.124939:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22d910cf-711e-44e0-9acf-212404ada550:3308:1874741455514240:0@lo:103: 00000100:00100000:3.0:1787892907.124957:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787892907.124983:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892907.125038:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90710153b200/0x825e3f5022b4a58e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a587 expref: 18 pid: 5842 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892907.125069:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455514112 00000100:00100000:2.0:1787892907.125075:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455514112 00010000:00010000:2.0:1787892907.125106:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9071013fde00/0x825e3f5022b4a5f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a5e9 expref: 19 pid: 5842 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892907.125117:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431374464 00000100:00100000:2.0:1787892907.125120:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431374464 00010000:00010000:2.0:1787892907.125131:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90710153a200/0x825e3f5022b4a652 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ad8f expref: 9 pid: 5842 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892907.125140:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455514368 00000100:00100000:2.0:1787892907.125142:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455514368 00010000:00010000:2.0:1787892907.125155:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9071421fbe00/0x825e3f5022b4a5b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a5b1 expref: 20 pid: 5842 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892907.125164:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455514240 00000100:00100000:2.0:1787892907.125167:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455514240 00010000:00010000:2.0:1787892907.125176:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907100031e00/0x825e3f5022b4a5e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a5db expref: 21 pid: 5842 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892907.125189:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787892907.125197:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107e83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22d910cf-711e-44e0-9acf-212404ada550+21:3305:x1874741455513984:12345-0@lo:103: 00010000:00010000:2.0:1787892907.125209:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787892907.125226:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907100030800/0x825e3f5022b4a5fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a5f7 expref: 21 pid: 5841 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.125236:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907100030800/0x825e3f5022b4a5fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x825e3f5022b4a5f7 expref: 21 pid: 5841 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.125253:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907100030800/0x825e3f5022b4a5fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x825e3f5022b4a5f7 expref: 21 pid: 5841 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.125270:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787892907.125316:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107e83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22d910cf-711e-44e0-9acf-212404ada550+20:3305:x1874741455513984:12345-0@lo:103: Request processed in 118us (3026us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892907.125322:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787892907.125339:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787892907.125345:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107e82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22d910cf-711e-44e0-9acf-212404ada550+19:3305:x1874741455514496:12345-0@lo:103: 00010000:00010000:2.0:1787892907.125353:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787892907.125358:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90710153b200/0x825e3f5022b4a58e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a587 expref: 19 pid: 5842 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.125366:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90710153b200/0x825e3f5022b4a58e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x825e3f5022b4a587 expref: 19 pid: 5842 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.125376:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90710153b200/0x825e3f5022b4a58e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x825e3f5022b4a587 expref: 19 pid: 5842 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.125384:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787892907.125404:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107e82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22d910cf-711e-44e0-9acf-212404ada550+18:3305:x1874741455514496:12345-0@lo:103: Request processed in 60us (3062us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892907.125410:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787892907.125423:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787892907.125435:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107e81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22d910cf-711e-44e0-9acf-212404ada550+17:3305:x1874741455514112:12345-0@lo:103: 00010000:00010000:2.0:1787892907.125442:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787892907.125447:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9071013fde00/0x825e3f5022b4a5f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a5e9 expref: 17 pid: 5842 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.125455:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9071013fde00/0x825e3f5022b4a5f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x825e3f5022b4a5e9 expref: 17 pid: 5842 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.125465:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9071013fde00/0x825e3f5022b4a5f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x825e3f5022b4a5e9 expref: 17 pid: 5842 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.125475:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787892907.125497:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107e81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22d910cf-711e-44e0-9acf-212404ada550+16:3305:x1874741455514112:12345-0@lo:103: Request processed in 62us (3111us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892907.125503:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787892907.125516:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 18 00000100:00100000:2.0:1787892907.125522:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107f2a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:18703558-96be-475d-879f-15397926f758+9:2361:x1874741431374464:12345-192.168.202.29@tcp:103: 00010000:00010000:2.0:1787892907.125531:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787892907.125535:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90710153a200/0x825e3f5022b4a652 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ad8f expref: 9 pid: 5842 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.125545:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90710153a200/0x825e3f5022b4a652 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ad8f expref: 9 pid: 5842 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.125555:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90710153a200/0x825e3f5022b4a652 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ad8f expref: 9 pid: 5842 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.125564:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787892907.125924:0:5834:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787892907.125934:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1787892907.126262:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455514112:0@lo:103: 00000100:00100000:3.0:1787892907.126272:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455513984:0@lo:103: 00000100:00100000:3.0:1787892907.126280:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455514496:0@lo:103: 00000100:00100000:2.0:1787892907.126405:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107f2a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:18703558-96be-475d-879f-15397926f758+8:2361:x1874741431374464:12345-192.168.202.29@tcp:103: Request processed in 881us (1658us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892907.126422:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 18 00000100:00100000:2.0:1787892907.126460:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787892907.126468:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22d910cf-711e-44e0-9acf-212404ada550+15:3308:x1874741455514368:12345-0@lo:103: 00010000:00010000:2.0:1787892907.126480:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787892907.126485:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9071421fbe00/0x825e3f5022b4a5b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a5b1 expref: 15 pid: 5842 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.126494:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9071421fbe00/0x825e3f5022b4a5b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x825e3f5022b4a5b1 expref: 15 pid: 5842 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.126505:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9071421fbe00/0x825e3f5022b4a5b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x825e3f5022b4a5b1 expref: 15 pid: 5842 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.126515:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787892907.126557:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22d910cf-711e-44e0-9acf-212404ada550+14:3308:x1874741455514368:12345-0@lo:103: Request processed in 90us (1657us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892907.126563:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787892907.126576:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787892907.126592:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22d910cf-711e-44e0-9acf-212404ada550+13:3308:x1874741455514240:12345-0@lo:103: 00010000:00010000:2.0:1787892907.126607:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787892907.126613:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907100031e00/0x825e3f5022b4a5e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a5db expref: 13 pid: 5842 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.126621:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907100031e00/0x825e3f5022b4a5e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x825e3f5022b4a5db expref: 13 pid: 5842 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.126630:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907100031e00/0x825e3f5022b4a5e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x825e3f5022b4a5db expref: 13 pid: 5842 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.126652:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff907104f47e00/0x825e3f5022b4a691 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.126661:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907104f47e00/0x825e3f5022b4a691 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.126675:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907104f47e00/0x825e3f5022b4a691 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.126681:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907104f47e00/0x825e3f5022b4a691 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.126687:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907104f47e00/0x825e3f5022b4a691 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.126694:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907104f47e00/0x825e3f5022b4a691 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.126700:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f47e00 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:2.0:1787892907.126704:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907104f47e00/0x825e3f5022b4a691 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.126711:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907104f47e00/0x825e3f5022b4a691 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.126733:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907104f47e00/0x825e3f5022b4a691 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892907.126743:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787892907.126788:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22d910cf-711e-44e0-9acf-212404ada550+12:3308:x1874741455514240:12345-0@lo:103: Request processed in 196us (1829us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892907.126802:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:0.0:1787892907.126921:0:8457:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907104f47e00/0x825e3f5022b4a691 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892907.126930:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907104f47e00/0x825e3f5022b4a691 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892907.126936:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907104f47e00/0x825e3f5022b4a691 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892907.129055:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22d910cf-711e-44e0-9acf-212404ada550:3308:1874741455514240:0@lo:103: 00000100:00100000:3.0:1787892907.129070:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22d910cf-711e-44e0-9acf-212404ada550:3308:1874741455514368:0@lo:103: 00000100:00100000:0.0:1787892907.722103:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22d910cf-711e-44e0-9acf-212404ada550:3306:1874741455514624:0@lo:400: 00000100:00100000:0.0:1787892907.722187:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892907.722438:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455514624 00000100:00100000:3.0:1787892907.722448:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455514624 00000100:00100000:3.0:1787892907.722501:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787892907.722511:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+12:3306:x1874741455514624:12345-0@lo:400: 00000100:00100000:1.0:1787892907.725199:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455515008:0@lo:400: 00000100:00100000:1.0:1787892907.726569:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892907.726856:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455515008 00000100:00100000:1.0:1787892907.726865:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455515008 00000100:00100000:1.0:1787892907.726921:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787892907.726929:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e62b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455515008:12345-0@lo:400: 00000100:00100000:1.0:1787892907.726983:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e62b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455515008:12345-0@lo:400: Request processed in 55us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892907.726990:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787892907.727015:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874741455514752:0@lo:400: 00000100:00100000:1.0:1787892907.727042:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892907.727059:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787892907.727064:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874741455514880:0@lo:400: 00000100:00100000:1.0:1787892907.727080:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787892907.727486:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff907107e82a00 x1874741455515008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892907.727503:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455515008:0@lo:400: 00000100:00100000:1.0:1787892907.727872:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455514752 00000100:00100000:1.0:1787892907.727878:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455514752 00000100:00100000:1.0:1787892907.727906:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455514880 00000100:00100000:1.0:1787892907.727909:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455514880 00000100:00100000:1.0:1787892907.727937:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787892907.727944:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e62a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874741455514752:12345-0@lo:400: 00000100:00100000:1.0:1787892907.727992:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e62a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874741455514752:12345-0@lo:400: Request processed in 49us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892907.727999:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787892907.728014:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787892907.728020:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e62aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874741455514880:12345-0@lo:400: 00000100:00100000:1.0:1787892907.728046:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e62aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874741455514880:12345-0@lo:400: Request processed in 26us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892907.728064:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787892907.729515:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874741455514880:0@lo:400: 00000100:00100000:1.0:1787892907.729532:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874741455514752:0@lo:400: 00000100:00080000:1.0:1787892907.729610:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787892907.730372:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+12:3306:x1874741455514624:12345-0@lo:400: Request processed in 7859us (8181us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892907.730383:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787892907.735481:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787892907.735508:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455515264:0@lo:400: 00000100:00100000:2.0:1787892907.735583:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892907.735893:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455515264 00000100:00100000:3.0:1787892907.735900:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455515264 00000100:00100000:3.0:1787892907.735965:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787892907.735973:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107e81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455515264:12345-0@lo:400: 00000100:00100000:3.0:1787892907.736025:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107e81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455515264:12345-0@lo:400: Request processed in 53us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892907.736047:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787892907.736236:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787892907.736258:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874741455515136:0@lo:400: 00000100:00100000:1.0:1787892907.736292:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892907.736322:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455515136 00000100:00100000:1.0:1787892907.736325:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455515136 00000100:00100000:1.0:1787892907.736357:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787892907.736363:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874741455515136:12345-0@lo:400: 00000100:00100000:1.0:1787892907.736395:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874741455515136:12345-0@lo:400: Request processed in 33us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892907.736401:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787892907.736440:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874741455515136:0@lo:400: 00000100:00080000:2.0:1787892907.737282:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787892907.737288:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787892907.737319:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff907107e82680 x1874741455515264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892907.737332:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455515264:0@lo:400: 00000100:00100000:0.0:1787892907.741774:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22d910cf-711e-44e0-9acf-212404ada550:3306:1874741455514624:0@lo:400: 00010000:00010000:2.0:1787892908.105189:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787892908.234253:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787892908.234281:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455515392:0@lo:13: 00000100:00100000:1.0:1787892908.234350:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892908.234570:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455515392 00000100:00100000:0.0:1787892908.234580:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455515392 00000100:00100000:0.0:1787892908.234641:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787892908.234651:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e629180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455515392:12345-0@lo:13: 00002000:00000024:0.0:1787892908.234696:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787892908.234770:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e629180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455515392:12345-0@lo:13: Request processed in 102us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892908.234778:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1787892908.234819:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90712ebbca80 x1874741455515392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892924 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892908.234840:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455515392:0@lo:13: 10000000:01000000:3.0:1787892908.936891:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787892908.936900:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9071072cc000 from 39 10000000:01000000:3.0:1787892908.936906:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787892908.936961:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff907104f46600/0x825e3f5022b4a698 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892908.936974:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff907104f46600/0x825e3f5022b4a698 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892908.936986:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff907104f46600/0x825e3f5022b4a698 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892908.937011:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455515520:0@lo:101: 00000100:00100000:3.0:1787892908.937097:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892908.937181:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff907139cde3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787892908.937210:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455515520 00000100:00100000:2.0:1787892908.937219:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455515520 00000100:00100000:2.0:1787892908.937346:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787892908.937356:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+12:5846:x1874741455515520:12345-0@lo:101: 00010000:00010000:2.0:1787892908.937371:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787892908.937386:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9071102b8c00/0x825e3f5022b4a69f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4a698 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892908.937412:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9071102b8c00/0x825e3f5022b4a69f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4a698 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892908.937423:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9071102b8c00/0x825e3f5022b4a69f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a698 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892908.937434:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071102b8c00, rc 0) 00000100:00100000:2.0:1787892908.937544:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+13:5846:x1874741455515520:12345-0@lo:101: Request processed in 189us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892908.937551:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787892908.938710:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455515520:0@lo:101: 00010000:00010000:3.0:1787892908.938732:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff907104f46600/0x825e3f5022b4a698 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a69f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892908.938744:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff907104f46600/0x825e3f5022b4a698 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a69f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892908.938828:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455515648:0@lo:501: 00000100:00100000:3.0:1787892908.938869:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892908.939650:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff907139cde3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787892908.939865:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455515648 00000100:00100000:1.0:1787892908.939873:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455515648 00000100:00100000:1.0:1787892908.939912:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787892908.939921:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+13:5846:x1874741455515648:12345-0@lo:501: 00000100:00100000:1.0:1787892908.940631:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+13:5846:x1874741455515648:12345-0@lo:501: Request processed in 708us (1758us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892908.940640:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787892908.941820:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455515648:0@lo:501: 00000100:00100000:3.0:1787892908.941891:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455515776:0@lo:503: 00000100:00100000:3.0:1787892908.941962:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892908.942006:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff907139cde3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787892908.942138:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455515776 00000100:00100000:1.0:1787892908.942145:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455515776 00000100:00100000:1.0:1787892908.942191:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787892908.942201:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+13:5846:x1874741455515776:12345-0@lo:503: 00000100:00100000:1.0:1787892908.942397:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+13:5846:x1874741455515776:12345-0@lo:503: Request processed in 196us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892908.942405:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787892908.942776:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455515776:0@lo:503: 00000100:00100000:2.0:1787892908.943347:0:8477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e82680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8477:1874741455515904:0@lo:502: 00000100:00100000:2.0:1787892908.943402:0:8477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892908.943440:0:8477:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710821f480 going to sleep for 11 seconds 00000100:00100000:1.0:1787892908.943621:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455515904 00000100:00100000:1.0:1787892908.943628:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455515904 00000100:00100000:1.0:1787892908.943669:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787892908.943851:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+13:8477:x1874741455515904:12345-0@lo:502: 00000100:00100000:1.0:1787892908.944187:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+13:8477:x1874741455515904:12345-0@lo:502: Request processed in 509us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892908.944194:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787892908.944386:0:8477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e82680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8477:1874741455515904:0@lo:502: 00000100:00100000:2.0:1787892908.944431:0:8477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e82680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8477:1874741455516032:0@lo:502: 00000100:00100000:2.0:1787892908.944589:0:8477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892908.944660:0:8477:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710821f480 going to sleep for 11 seconds 00000100:00100000:3.0:1787892908.944746:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455516032 00000100:00100000:3.0:1787892908.944835:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455516032 00000100:00100000:3.0:1787892908.944905:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787892908.944914:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+13:8477:x1874741455516032:12345-0@lo:502: 00000100:00100000:2.0:1787892908.946224:0:8477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e82680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8477:1874741455516032:0@lo:502: 00000040:00080000:2.0:1787892908.946274:0:8477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787892908.946557:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787892908.946577:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787892908.946597:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff907104f46600/0x825e3f5022b4a698 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a69f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892908.946609:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff907104f46600/0x825e3f5022b4a698 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a69f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787892908.946618:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1787892908.946620:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1787892908.946623:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787892908.946660:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff907103f06c00/0x825e3f5022b4a6a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892908.946667:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff907103f06c00/0x825e3f5022b4a6a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892908.946686:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff907103f06c00/0x825e3f5022b4a6a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892908.946705:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455516160:0@lo:101: 00000100:00100000:0.0:1787892908.946801:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892908.947014:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+13:8477:x1874741455516032:12345-0@lo:502: Request processed in 162us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892908.947026:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787892908.947229:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff907110c4d180 going to sleep for 11 seconds 00000100:00100000:3.0:1787892908.947401:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455516160 00000100:00100000:3.0:1787892908.947408:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455516160 00000100:00100000:3.0:1787892908.947437:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787892908.947445:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+13:5846:x1874741455516160:12345-0@lo:101: 00010000:00010000:3.0:1787892908.947474:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787892908.947488:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907104f47400/0x825e3f5022b4a6ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4a6a6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892908.947512:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907104f47400/0x825e3f5022b4a6ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4a6a6 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892908.947522:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907104f47400/0x825e3f5022b4a6ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a6a6 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892908.947530:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907104f47400, rc 0) 00000100:00100000:3.0:1787892908.947574:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+14:5846:x1874741455516160:12345-0@lo:101: Request processed in 129us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892908.947588:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787892908.947671:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455516160:0@lo:101: 00010000:00010000:0.0:1787892908.947695:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff907103f06c00/0x825e3f5022b4a6a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a6ad expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892908.947705:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff907103f06c00/0x825e3f5022b4a6a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a6ad expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892908.947784:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455516288:0@lo:501: 00000100:00100000:0.0:1787892908.947810:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892908.947826:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff907110c4d180 going to sleep for 11 seconds 00000100:00100000:3.0:1787892908.947982:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455516288 00000100:00100000:3.0:1787892908.947987:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455516288 00000100:00100000:3.0:1787892908.948004:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787892908.948010:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+14:5846:x1874741455516288:12345-0@lo:501: 00000100:00100000:3.0:1787892908.948288:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+14:5846:x1874741455516288:12345-0@lo:501: Request processed in 276us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892908.948294:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787892908.948429:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455516288:0@lo:501: 00000100:00100000:0.0:1787892908.948471:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455516416:0@lo:503: 00000100:00100000:0.0:1787892908.948510:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892908.948530:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff907110c4d180 going to sleep for 11 seconds 00000100:00100000:3.0:1787892908.949508:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455516416 00000100:00100000:3.0:1787892908.949518:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455516416 00000100:00100000:3.0:1787892908.949552:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787892908.949560:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+14:5846:x1874741455516416:12345-0@lo:503: 00000100:00100000:3.0:1787892908.949805:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+14:5846:x1874741455516416:12345-0@lo:503: Request processed in 244us (1294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892908.949812:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787892908.950019:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455516416:0@lo:503: 00000100:00100000:0.0:1787892908.950728:0:8478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8478:1874741455516544:0@lo:502: 00000100:00100000:0.0:1787892908.950811:0:8478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892908.950838:0:8478:0:(client.c:2715:ptlrpc_set_wait()) set ffff907110c4d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787892908.950940:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455516544 00000100:00100000:3.0:1787892908.950946:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455516544 00000100:00100000:3.0:1787892908.950974:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787892908.950982:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+14:8478:x1874741455516544:12345-0@lo:502: 00000100:00100000:3.0:1787892908.951178:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+14:8478:x1874741455516544:12345-0@lo:502: Request processed in 196us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892908.951185:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787892908.951378:0:8478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8478:1874741455516544:0@lo:502: 00000020:01000000:0.0:1787892908.951402:0:8478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787892908.951410:0:8478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787892908.951413:0:8478:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787892908.951418:0:8478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787892908.951439:0:8478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8478:1874741455516672:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787892908.951490:0:8478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892908.951510:0:8478:0:(client.c:2715:ptlrpc_set_wait()) set ffff907110c4d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787892908.951624:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455516672 00000100:00100000:3.0:1787892908.951629:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455516672 00000100:00100000:3.0:1787892908.951647:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787892908.951654:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+14:8478:x1874741455516672:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787892908.951811:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+14:8478:x1874741455516672:12345-0@lo:502:llog_process_th.0 Request processed in 157us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892908.951829:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787892908.951948:0:8478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8478:1874741455516672:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787892908.951966:0:8478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787892908.951971:0:8478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787892908.951972:0:8478:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787892908.951976:0:8478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1787892908.952742:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1787892908.952792:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787892908.952802:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff907103f06c00/0x825e3f5022b4a6a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a6ad expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892908.952815:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff907103f06c00/0x825e3f5022b4a6a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a6ad expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787892908.952825:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787892908.952828:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff907105af0000 from 39 10000000:01000000:3.0:1787892908.952830:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787892908.952862:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff907104f46e00/0x825e3f5022b4a6b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892908.952870:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff907104f46e00/0x825e3f5022b4a6b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892908.952880:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff907104f46e00/0x825e3f5022b4a6b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892908.952895:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455516800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787892908.952934:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892908.952967:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071086436c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787892908.954055:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455516800 00000100:00100000:0.0:1787892908.954066:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455516800 00000100:00100000:0.0:1787892908.954193:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787892908.954202:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+14:5846:x1874741455516800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787892908.954215:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787892908.954231:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907103f06e00/0x825e3f5022b4a6bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4a6b4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892908.954381:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907103f06e00/0x825e3f5022b4a6bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4a6b4 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892908.954392:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907103f06e00/0x825e3f5022b4a6bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a6b4 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892908.954401:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907103f06e00, rc 0) 00000100:00100000:0.0:1787892908.954541:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+15:5846:x1874741455516800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 340us (1606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892908.954549:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787892908.955930:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455516800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787892908.955952:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff907104f46e00/0x825e3f5022b4a6b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a6bb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892908.955986:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff907104f46e00/0x825e3f5022b4a6b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a6bb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892908.956066:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455516928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787892908.956126:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892908.956171:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071086436c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787892908.956346:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455516928 00000100:00100000:1.0:1787892908.956353:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455516928 00000100:00100000:1.0:1787892908.956396:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787892908.956405:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+15:5846:x1874741455516928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787892908.957185:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+15:5846:x1874741455516928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 778us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892908.957194:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787892908.957588:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455516928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787892908.957635:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455517056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787892908.957748:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892908.957803:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071086436c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787892908.957920:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455517056 00000100:00100000:2.0:1787892908.957926:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455517056 00000100:00100000:2.0:1787892908.957964:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787892908.957972:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+15:5846:x1874741455517056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787892908.958325:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+15:5846:x1874741455517056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 353us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892908.958332:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787892908.958411:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455517056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787892908.965225:0:8479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8479:1874741455517184:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787892908.965385:0:8479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892908.965432:0:8479:0:(client.c:2715:ptlrpc_set_wait()) set ffff907110c4d540 going to sleep for 11 seconds 00000100:00100000:2.0:1787892908.966031:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455517184 00000100:00100000:2.0:1787892908.966042:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455517184 00000100:00100000:3.0:1787892908.970904:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787892908.970921:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+15:8479:x1874741455517184:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787892908.971453:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+15:8479:x1874741455517184:12345-0@lo:502:llog_process_th.0 Request processed in 534us (6066us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892908.971470:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787892908.972498:0:8479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8479:1874741455517184:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787892908.972616:0:8479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e82680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8479:1874741455517312:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787892908.972672:0:8479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892908.972849:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455517312 00000100:00100000:1.0:1787892908.972857:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455517312 00000100:00100000:1.0:1787892908.972910:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787892908.972918:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+15:8479:x1874741455517312:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787892908.973122:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+15:8479:x1874741455517312:12345-0@lo:502:llog_process_th.0 Request processed in 205us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892908.973138:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787892908.973555:0:8479:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710821fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787892908.973573:0:8479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e82680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8479:1874741455517312:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787892908.973605:0:8479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787892908.973884:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787892908.973905:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787892908.973916:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff907104f46e00/0x825e3f5022b4a6b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a6bb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892908.973940:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff907104f46e00/0x825e3f5022b4a6b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a6bb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892908.973948:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787892908.973951:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1787892908.973954:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787892908.973982:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9071102b9400/0x825e3f5022b4a6c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892908.973989:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9071102b9400/0x825e3f5022b4a6c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892908.973998:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9071102b9400/0x825e3f5022b4a6c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892908.974013:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455517440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787892908.974064:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892908.974094:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710821f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787892908.974109:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455517440 00000100:00100000:2.0:1787892908.974114:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455517440 00000100:00100000:2.0:1787892908.974147:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787892908.974154:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+15:5846:x1874741455517440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787892908.974163:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787892908.974176:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9071102b9e00/0x825e3f5022b4a6c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4a6c2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892908.974195:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9071102b9e00/0x825e3f5022b4a6c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4a6c2 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892908.974215:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9071102b9e00/0x825e3f5022b4a6c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a6c2 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892908.974224:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071102b9e00, rc 0) 00000100:00100000:2.0:1787892908.974265:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+16:5846:x1874741455517440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892908.974272:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787892908.974303:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455517440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787892908.974315:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9071102b9400/0x825e3f5022b4a6c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a6c9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892908.974323:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9071102b9400/0x825e3f5022b4a6c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a6c9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892908.974361:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455517568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787892908.974384:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892908.974397:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710821f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787892908.974407:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455517568 00000100:00100000:2.0:1787892908.974410:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455517568 00000100:00100000:2.0:1787892908.974427:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787892908.974433:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+16:5846:x1874741455517568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787892908.974676:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+16:5846:x1874741455517568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 242us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892908.974683:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787892908.974710:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455517568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787892908.974743:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455517696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787892908.974799:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892908.974812:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710821f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787892908.974826:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455517696 00000100:00100000:2.0:1787892908.974829:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455517696 00000100:00100000:2.0:1787892908.974845:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787892908.974850:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+16:5846:x1874741455517696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787892908.974981:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+16:5846:x1874741455517696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892908.974988:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787892908.975020:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455517696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787892908.975185:0:8480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e82a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8480:1874741455517824:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787892908.975217:0:8480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892908.975234:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455517824 00000100:00100000:2.0:1787892908.975237:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455517824 00000100:00100000:2.0:1787892908.975257:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787892908.975262:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+16:8480:x1874741455517824:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787892908.975379:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+16:8480:x1874741455517824:12345-0@lo:502:llog_process_th.0 Request processed in 115us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892908.975386:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787892908.975411:0:8480:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710821f900 going to sleep for 11 seconds 00000100:00100000:2.0:1787892908.975422:0:8480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e82a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8480:1874741455517824:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787892908.975441:0:8480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787892908.975449:0:8480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787892908.975456:0:8480:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787892908.975462:0:8480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787892908.975482:0:8480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e82a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8480:1874741455517952:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787892908.975513:0:8480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892908.975530:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455517952 00000100:00100000:2.0:1787892908.975533:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455517952 00000100:00100000:2.0:1787892908.975551:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787892908.975557:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+16:8480:x1874741455517952:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787892908.975664:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+16:8480:x1874741455517952:12345-0@lo:502:llog_process_th.0 Request processed in 107us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892908.975670:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787892908.975696:0:8480:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710821f900 going to sleep for 11 seconds 00000100:00100000:2.0:1787892908.975706:0:8480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e82a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8480:1874741455517952:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787892908.975721:0:8480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787892908.975725:0:8480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787892908.975727:0:8480:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787892908.975730:0:8480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1787892908.975796:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1787892908.975809:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787892908.975817:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9071102b9400/0x825e3f5022b4a6c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a6c9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892908.975826:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9071102b9400/0x825e3f5022b4a6c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a6c9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892908.975835:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787892908.975837:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90710510c800 from 39 10000000:01000000:2.0:1787892908.975840:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787892908.975858:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9071102b8600/0x825e3f5022b4a6d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892908.975870:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9071102b8600/0x825e3f5022b4a6d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892908.975879:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9071102b8600/0x825e3f5022b4a6d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892908.975892:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455518080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787892908.975915:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892908.975928:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710821f900 going to sleep for 11 seconds 00000100:00100000:2.0:1787892908.975939:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455518080 00000100:00100000:2.0:1787892908.975942:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455518080 00000100:00100000:2.0:1787892908.975962:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787892908.975967:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+16:5846:x1874741455518080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787892908.975975:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787892908.975985:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9071102b8800/0x825e3f5022b4a6d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4a6d0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892908.976001:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9071102b8800/0x825e3f5022b4a6d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4a6d0 expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892908.976009:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9071102b8800/0x825e3f5022b4a6d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a6d0 expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892908.976016:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071102b8800, rc 0) 00000100:00100000:2.0:1787892908.976042:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+17:5846:x1874741455518080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 75us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892908.976048:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787892908.976082:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455518080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787892908.976092:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9071102b8600/0x825e3f5022b4a6d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a6d7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892908.976100:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9071102b8600/0x825e3f5022b4a6d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a6d7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892908.976134:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455518208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787892908.976156:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892908.976169:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710821f900 going to sleep for 11 seconds 00000100:00100000:2.0:1787892908.976178:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455518208 00000100:00100000:2.0:1787892908.976181:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455518208 00000100:00100000:2.0:1787892908.976199:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787892908.976204:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+17:5846:x1874741455518208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787892908.976368:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+17:5846:x1874741455518208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 162us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892908.976374:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787892908.976401:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455518208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787892908.976423:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455518336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787892908.976452:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892908.976465:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710821f900 going to sleep for 11 seconds 00000100:00100000:2.0:1787892908.976475:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455518336 00000100:00100000:2.0:1787892908.976478:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455518336 00000100:00100000:2.0:1787892908.976498:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787892908.976503:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+17:5846:x1874741455518336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787892908.976626:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+17:5846:x1874741455518336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 122us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892908.976638:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787892908.976670:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455518336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787892908.992722:0:8481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e82a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8481:1874741455518464:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787892908.993392:0:8481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892908.993489:0:8481:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710821f840 going to sleep for 11 seconds 00000100:00100000:3.0:1787892908.998164:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455518464 00000100:00100000:3.0:1787892908.998179:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455518464 00000100:00100000:3.0:1787892908.998345:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787892908.998357:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+17:8481:x1874741455518464:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787892908.998694:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+17:8481:x1874741455518464:12345-0@lo:502:llog_process_th.0 Request processed in 338us (5303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892908.998703:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787892908.998819:0:8481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e82a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8481:1874741455518464:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787892909.000446:0:8481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e628e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8481:1874741455518592:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787892909.000540:0:8481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892909.005608:0:8481:0:(client.c:2715:ptlrpc_set_wait()) set ffff907105efa0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787892909.006062:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455518592 00000100:00100000:2.0:1787892909.006083:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455518592 00000100:00100000:2.0:1787892909.006142:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787892909.006151:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+17:8481:x1874741455518592:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787892909.006863:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+17:8481:x1874741455518592:12345-0@lo:502:llog_process_th.0 Request processed in 709us (6319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892909.006873:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787892909.007224:0:8481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e628e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8481:1874741455518592:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787892909.007273:0:8481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787892909.007567:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787892909.007596:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787892909.007608:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9071102b8600/0x825e3f5022b4a6d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a6d7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892909.007621:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9071102b8600/0x825e3f5022b4a6d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a6d7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892909.007632:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787892909.007635:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1787892909.007638:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787892909.007677:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9071102b9800/0x825e3f5022b4a6de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892909.007685:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9071102b9800/0x825e3f5022b4a6de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892909.007876:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9071102b9800/0x825e3f5022b4a6de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892909.007903:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e81880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455518720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787892909.007956:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892909.007999:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710821f840 going to sleep for 11 seconds 00000100:00100000:3.0:1787892909.008120:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455518720 00000100:00100000:3.0:1787892909.008127:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455518720 00000100:00100000:3.0:1787892909.008179:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787892909.008188:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+17:5846:x1874741455518720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787892909.008200:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787892909.008213:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907104f46c00/0x825e3f5022b4a6e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4a6de expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892909.008234:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907104f46c00/0x825e3f5022b4a6e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4a6de expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892909.008256:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907104f46c00/0x825e3f5022b4a6e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a6de expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892909.008264:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907104f46c00, rc 0) 00000100:00100000:3.0:1787892909.008302:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+18:5846:x1874741455518720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892909.008309:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787892909.008665:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e81880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455518720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787892909.008679:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9071102b9800/0x825e3f5022b4a6de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a6e5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892909.008687:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9071102b9800/0x825e3f5022b4a6de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a6e5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892909.009150:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e628e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455518848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787892909.009184:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892909.009207:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff907105efa0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787892909.009377:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455518848 00000100:00100000:3.0:1787892909.009383:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455518848 00000100:00100000:3.0:1787892909.009421:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787892909.009429:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+18:5846:x1874741455518848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787892909.010344:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+18:5846:x1874741455518848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 912us (1155us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892909.010353:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787892909.010534:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e628e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455518848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787892909.010589:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e628e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455518976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787892909.010630:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892909.010659:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff907105efa0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787892909.010822:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455518976 00000100:00100000:3.0:1787892909.010827:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455518976 00000100:00100000:3.0:1787892909.010868:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787892909.010876:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+18:5846:x1874741455518976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787892909.011008:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+18:5846:x1874741455518976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 134us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892909.011020:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787892909.011217:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e628e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455518976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787892909.011824:0:8482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e628e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8482:1874741455519104:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787892909.011970:0:8482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892909.012000:0:8482:0:(client.c:2715:ptlrpc_set_wait()) set ffff907105efa540 going to sleep for 11 seconds 00000100:00100000:3.0:1787892909.012048:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455519104 00000100:00100000:3.0:1787892909.012053:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455519104 00000100:00100000:3.0:1787892909.012170:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787892909.012179:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+18:8482:x1874741455519104:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787892909.012370:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+18:8482:x1874741455519104:12345-0@lo:502:llog_process_th.0 Request processed in 193us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892909.012378:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787892909.012690:0:8482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e628e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8482:1874741455519104:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787892909.012715:0:8482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787892909.012725:0:8482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787892909.012727:0:8482:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787892909.012732:0:8482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787892909.012784:0:8482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8482:1874741455519232:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787892909.012819:0:8482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892909.013063:0:8482:0:(client.c:2715:ptlrpc_set_wait()) set ffff907110c4d180 going to sleep for 11 seconds 00000100:00100000:1.0:1787892909.013188:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455519232 00000100:00100000:1.0:1787892909.013194:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455519232 00000100:00100000:1.0:1787892909.013220:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787892909.013226:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+18:8482:x1874741455519232:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787892909.013634:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+18:8482:x1874741455519232:12345-0@lo:502:llog_process_th.0 Request processed in 406us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892909.013641:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787892909.014178:0:8482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8482:1874741455519232:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787892909.014339:0:8482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787892909.014348:0:8482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787892909.014350:0:8482:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787892909.014356:0:8482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1787892909.014656:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1787892909.014677:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787892909.014687:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9071102b9800/0x825e3f5022b4a6de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a6e5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892909.014697:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9071102b9800/0x825e3f5022b4a6de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a6e5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787892909.014706:0:5846:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787892909.014708:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff907105a88000 from 1 10000000:01000000:0.0:1787892909.014711:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787892909.014742:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff907103f07400/0x825e3f5022b4a6ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892909.014749:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff907103f07400/0x825e3f5022b4a6ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892909.014949:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff907103f07400/0x825e3f5022b4a6ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892909.014981:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455519360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787892909.015032:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892909.015109:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff907110c4d180 going to sleep for 11 seconds 00000100:00100000:1.0:1787892909.015203:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455519360 00000100:00100000:1.0:1787892909.015209:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455519360 00000100:00100000:1.0:1787892909.015345:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787892909.015356:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+18:5846:x1874741455519360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787892909.015368:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787892909.015380:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9071421fae00/0x825e3f5022b4a6f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4a6ec expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892909.015401:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9071421fae00/0x825e3f5022b4a6f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4a6ec expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892909.015410:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9071421fae00/0x825e3f5022b4a6f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a6ec expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892909.015425:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071421fae00, rc 0) 00000100:00100000:1.0:1787892909.015473:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+19:5846:x1874741455519360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892909.015479:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787892909.015542:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455519360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787892909.015565:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff907103f07400/0x825e3f5022b4a6ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a6f3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892909.015574:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff907103f07400/0x825e3f5022b4a6ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a6f3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892909.015629:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455519488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787892909.015653:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892909.016047:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff907110c4d180 going to sleep for 11 seconds 00000100:00100000:3.0:1787892909.016158:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455519488 00000100:00100000:3.0:1787892909.016164:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455519488 00000100:00100000:3.0:1787892909.016189:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787892909.016195:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+19:5846:x1874741455519488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787892909.016527:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+19:5846:x1874741455519488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 331us (873us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787892909.016534:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787892909.016728:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455519488:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1787892909.016773:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787892909.016779:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff907103f07400/0x825e3f5022b4a6ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a6f3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892909.016788:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff907103f07400/0x825e3f5022b4a6ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a6f3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892909.128970:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787892909.364624:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892909.364716:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431374592 00000100:00100000:3.0:1787892909.364727:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431374592 00000100:00100000:3.0:1787892909.364815:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 163 00000100:00100000:3.0:1787892909.364826:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+8:5604:x1874741431374592:12345-192.168.202.29@tcp:101: 00010000:00010000:3.0:1787892909.364846:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787892909.364867:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907104f46a00/0x825e3f5022b4a6fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821adf8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892909.364899:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907104f46a00/0x825e3f5022b4a6fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821adf8 expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892909.364911:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907104f46a00/0x825e3f5022b4a6fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821adf8 expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892909.364936:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907104f46a00, rc 0) 00000100:00100000:3.0:1787892909.365014:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+9:5604:x1874741431374592:12345-192.168.202.29@tcp:101: Request processed in 189us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892909.365020:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 163 00000100:00100000:1.0:1787892909.368845:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787892909.368933:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431374720 00000100:00100000:2.0:1787892909.368944:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431374720 00000100:00100000:2.0:1787892909.368995:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 164 00000100:00100000:2.0:1787892909.369005:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+9:5604:x1874741431374720:12345-192.168.202.29@tcp:501: 00000100:00100000:2.0:1787892909.369385:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+9:5604:x1874741431374720:12345-192.168.202.29@tcp:501: Request processed in 380us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892909.369393:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 164 00000100:00100000:0.0:1787892909.373209:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787892909.373326:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431374848 00000100:00100000:1.0:1787892909.373337:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431374848 00000100:00100000:1.0:1787892909.373390:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 165 00000100:00100000:1.0:1787892909.373400:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+9:5604:x1874741431374848:12345-192.168.202.29@tcp:503: 00000100:00100000:1.0:1787892909.373677:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+9:5604:x1874741431374848:12345-192.168.202.29@tcp:503: Request processed in 277us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892909.373684:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 165 00000100:00100000:1.0:1787892909.385638:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892909.385738:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431374976 00000100:00100000:3.0:1787892909.385749:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431374976 00000100:00100000:3.0:1787892909.385845:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 166 00000100:00100000:3.0:1787892909.385858:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+9:6075:x1874741431374976:12345-192.168.202.29@tcp:502: 00000100:00100000:3.0:1787892909.386182:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+9:6075:x1874741431374976:12345-192.168.202.29@tcp:502: Request processed in 324us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892909.386190:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 166 00000100:00100000:3.0:1787892909.390321:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787892909.392329:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431375104 00000100:00100000:2.0:1787892909.392346:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431375104 00000100:00100000:2.0:1787892909.392425:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 167 00000100:00100000:2.0:1787892909.392436:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+9:6075:x1874741431375104:12345-192.168.202.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787892909.393078:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+9:6075:x1874741431375104:12345-192.168.202.29@tcp:502:llog_process_th.0 Request processed in 631us (2753us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892909.393088:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 167 00000100:00100000:0.0:1787892909.398793:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787892909.398868:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431375232 00000100:00100000:1.0:1787892909.398880:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431375232 00000100:00100000:1.0:1787892909.398941:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 168 00000100:00100000:1.0:1787892909.398952:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+9:5604:x1874741431375232:12345-192.168.202.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787892909.398969:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787892909.398987:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9071421fa800/0x825e3f5022b4a701 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821adff expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892909.399016:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9071421fa800/0x825e3f5022b4a701 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821adff expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892909.399027:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9071421fa800/0x825e3f5022b4a701 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821adff expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892909.399050:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071421fa800, rc 0) 00000100:00100000:1.0:1787892909.399120:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+10:5604:x1874741431375232:12345-192.168.202.29@tcp:101:ll_cfg_requeue.0 Request processed in 170us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892909.399127:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 168 00000100:00100000:1.0:1787892909.402497:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787892909.403044:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431375360 00000100:00100000:2.0:1787892909.403055:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431375360 00000100:00100000:2.0:1787892909.403122:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 169 00000100:00100000:2.0:1787892909.403133:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+10:5604:x1874741431375360:12345-192.168.202.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787892909.403516:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+10:5604:x1874741431375360:12345-192.168.202.29@tcp:501:ll_cfg_requeue.0 Request processed in 383us (1028us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787892909.403524:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 169 00010000:00010000:3.0:1787892910.154304:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787892910.543145:0:8519:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcf3693dd0 20000000:00000080:1.0:1787892910.543164:0:8519:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff907137d35800 uarg=0000000000000000 20000000:01000000:1.0:1787892910.543207:0:8519:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787892910.543213:0:8519:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787892910.543218:0:8519:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787892910.549366:0:8520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1787892910.550361:0:8519:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1787892910.556376:0:8519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1787892910.556441:0:8519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1787892910.556851:0:8519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1787892910.556877:0:8519:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787892910.556900:0:8519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9071421faa00/0x825e3f5022b4a708 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892910.556920:0:8519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90710153bc00/0x825e3f5022b4a47d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a476 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892910.556929:0:8519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9071421fa600/0x825e3f5022b4a4df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a4d8 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892910.556936:0:8519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907100030c00/0x825e3f5022b4a5aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a5a3 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892910.556945:0:8519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90710153b000/0x825e3f5022b4a667 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821adc7 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892910.556966:0:8519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9071421faa00/0x825e3f5022b4a708 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892910.557014:0:8519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90710153b000/0x825e3f5022b4a667 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821adc7 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892910.557032:0:8519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90710153b000/0x825e3f5022b4a667 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821adc7 expref: 9 pid: 5841 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892910.557048:0:8519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e628e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8519:1874741455519616:192.168.202.29@tcp:104: 00010000:00010000:1.0:1787892910.557243:0:8519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907100030c00/0x825e3f5022b4a5aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x825e3f5022b4a5a3 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892910.557252:0:8519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907100030c00/0x825e3f5022b4a5aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x825e3f5022b4a5a3 expref: 18 pid: 5842 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892910.557261:0:8519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e629f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8519:1874741455519744:0@lo:104: 00000100:00100000:1.0:1787892910.557306:0:8519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787892910.557385:0:8519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9071421fa600/0x825e3f5022b4a4df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x825e3f5022b4a4d8 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892910.557394:0:8519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9071421fa600/0x825e3f5022b4a4df lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x825e3f5022b4a4d8 expref: 18 pid: 5843 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892910.557402:0:8519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e628380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8519:1874741455519872:0@lo:104: 00000100:00100000:1.0:1787892910.557430:0:8519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787892910.560228:0:8519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90710153bc00/0x825e3f5022b4a47d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x825e3f5022b4a476 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892910.560262:0:8519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff90710153bc00/0x825e3f5022b4a47d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x825e3f5022b4a476 expref: 18 pid: 5842 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892910.560282:0:8519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9071083a3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8519:1874741455520000:0@lo:104: 00000100:00100000:1.0:1787892910.560337:0:8519:0:(client.c:2715:ptlrpc_set_wait()) set ffff907110297240 going to sleep for 11 seconds 00000100:00100000:2.0:1787892910.560468:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787892910.560500:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892910.561202:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455519744 00000100:00100000:0.0:1787892910.561215:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455519744 00000100:00100000:0.0:1787892910.561266:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455519872 00000100:00100000:0.0:1787892910.561280:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455519872 00000100:00100000:0.0:1787892910.561298:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455520000 00000100:00100000:0.0:1787892910.561301:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455520000 00000100:00100000:0.0:1787892910.561314:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787892910.561323:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e62a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22d910cf-711e-44e0-9acf-212404ada550+5:8519:x1874741455519744:12345-0@lo:104: 00010000:00010000:0.0:1787892910.561338:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff90710153b600/0x825e3f5022b4a5a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a5aa expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892910.562200:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787892910.562214:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f9e9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22d910cf-711e-44e0-9acf-212404ada550+5:8519:x1874741455519872:12345-0@lo:104: 00010000:00010000:2.0:1787892910.562228:0:5831:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff907100030e00/0x825e3f5022b4a4d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a4df expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892910.562335:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787892910.562342:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e62a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22d910cf-711e-44e0-9acf-212404ada550+5:8519:x1874741455519744:12345-0@lo:104: Request processed in 1020us (5037us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892910.562350:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787892910.562372:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787892910.562379:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107e81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22d910cf-711e-44e0-9acf-212404ada550+4:8519:x1874741455520000:12345-0@lo:104: 00010000:00010000:0.0:1787892910.562386:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff90710153a000/0x825e3f5022b4a476 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a47d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892910.564921:0:5831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787892910.564938:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f9e9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22d910cf-711e-44e0-9acf-212404ada550+4:8519:x1874741455519872:12345-0@lo:104: Request processed in 2723us (7502us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892910.564950:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1787892910.565035:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787892910.565042:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff90710153b600/0x825e3f5022b4a5a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a5aa expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892910.565051:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153b600 already unused, calling callback (ffffffffc1c05c20) 10000000:00010000:2.0:1787892910.565055:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff90710153b600/0x825e3f5022b4a5a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x825e3f5022b4a5aa expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892910.565375:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892910.565402:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431375488 00000100:00100000:3.0:1787892910.565409:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431375488 00010000:00010000:3.0:1787892910.565440:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90710153b000/0x825e3f5022b4a667 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821adc7 expref: 10 pid: 5841 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892910.565478:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 21 00000100:00100000:3.0:1787892910.565487:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebbc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:18703558-96be-475d-879f-15397926f758+10:2361:x1874741431375488:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787892910.565503:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787892910.565509:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90710153b000/0x825e3f5022b4a667 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821adc7 expref: 10 pid: 5841 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892910.565521:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90710153b000/0x825e3f5022b4a667 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821adc7 expref: 10 pid: 5841 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892910.565562:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787892910.565620:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebbc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:18703558-96be-475d-879f-15397926f758+10:2361:x1874741431375488:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 134us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892910.565627:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 21 00010000:00010000:2.0:1787892910.566326:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff90710153b600/0x825e3f5022b4a5a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x825e3f5022b4a5aa expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787892910.566335:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff90710153b600/0x825e3f5022b4a5a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x825e3f5022b4a5aa expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892910.566355:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787892910.566394:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff90710153b600/0x825e3f5022b4a5a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a5aa expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892910.566400:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787892910.566426:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff90710153b600/0x825e3f5022b4a5a3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a5aa expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892910.566433:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff90710153b600/0x825e3f5022b4a5a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a5aa expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892910.566450:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787892910.566454:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff907100030e00/0x825e3f5022b4a4d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a4df expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892910.566473:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907100030e00 already unused, calling callback (ffffffffc1c05c20) 10000000:00010000:2.0:1787892910.566476:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff907100030e00/0x825e3f5022b4a4d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x825e3f5022b4a4df expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892910.566483:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff907100030e00/0x825e3f5022b4a4d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x825e3f5022b4a4df expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787892910.566489:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff907100030e00/0x825e3f5022b4a4d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x825e3f5022b4a4df expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892910.566494:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787892910.566509:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff907100030e00/0x825e3f5022b4a4d8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a4df expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892910.566515:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787892910.566528:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff907100030e00/0x825e3f5022b4a4d8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a4df expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892910.566639:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff907100030e00/0x825e3f5022b4a4d8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a4df expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892910.566812:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892910.566816:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892910.566818:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787892910.566841:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455520128:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787892910.566905:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892910.566955:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787892910.566962:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455520256:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787892910.566982:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892910.567016:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455520128 00000100:00100000:2.0:1787892910.567022:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455520128 00010000:00010000:2.0:1787892910.567051:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907100030c00/0x825e3f5022b4a5aa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a5a3 expref: 19 pid: 5842 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892910.567151:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455520256 00000100:00100000:2.0:1787892910.567155:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455520256 00010000:00010000:2.0:1787892910.567168:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9071421fa600/0x825e3f5022b4a4df lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a4d8 expref: 20 pid: 5843 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892910.567186:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787892910.567193:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107e81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22d910cf-711e-44e0-9acf-212404ada550+20:3305:x1874741455520128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787892910.567206:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787892910.567212:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907100030c00/0x825e3f5022b4a5aa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a5a3 expref: 20 pid: 5842 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892910.567234:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907100030c00/0x825e3f5022b4a5aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x825e3f5022b4a5a3 expref: 20 pid: 5842 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892910.567251:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787892910.567283:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107e81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22d910cf-711e-44e0-9acf-212404ada550+20:3305:x1874741455520128:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892910.567291:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787892910.567309:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787892910.567315:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107e81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22d910cf-711e-44e0-9acf-212404ada550+19:3305:x1874741455520256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787892910.567322:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787892910.567326:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9071421fa600/0x825e3f5022b4a4df lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a4d8 expref: 19 pid: 5843 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892910.567334:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9071421fa600/0x825e3f5022b4a4df lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x825e3f5022b4a4d8 expref: 19 pid: 5843 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892910.567343:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787892910.567362:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107e81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22d910cf-711e-44e0-9acf-212404ada550+19:3305:x1874741455520256:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892910.567368:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787892910.567401:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455520256:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787892910.567410:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455520128:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787892910.567455:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787892910.567911:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787892910.567920:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107e81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:22d910cf-711e-44e0-9acf-212404ada550+3:8519:x1874741455520000:12345-0@lo:104: Request processed in 5541us (7420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892910.567929:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1787892910.567997:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787892910.568004:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff90710153a000/0x825e3f5022b4a476 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a47d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892910.568012:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153a000 already unused, calling callback (ffffffffc1c05c20) 10000000:00010000:3.0:1787892910.568016:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff90710153a000/0x825e3f5022b4a476 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x825e3f5022b4a47d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892910.568024:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff90710153a000/0x825e3f5022b4a476 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x825e3f5022b4a47d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787892910.568032:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff90710153a000/0x825e3f5022b4a476 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x825e3f5022b4a47d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787892910.568038:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787892910.568181:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff90710153a000/0x825e3f5022b4a476 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a47d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892910.568187:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787892910.568213:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff90710153a000/0x825e3f5022b4a476 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a47d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892910.568219:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff90710153a000/0x825e3f5022b4a476 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a47d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892910.568249:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787892910.568251:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787892910.568254:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787892910.568288:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787892910.568301:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22d910cf-711e-44e0-9acf-212404ada550:3308:1874741455520384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787892910.568339:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892910.568469:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455520384 00000100:00100000:3.0:1787892910.568476:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455520384 00010000:00010000:3.0:1787892910.568499:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90710153bc00/0x825e3f5022b4a47d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a476 expref: 19 pid: 5842 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892910.568642:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787892910.568664:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107e83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22d910cf-711e-44e0-9acf-212404ada550+19:3308:x1874741455520384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787892910.568676:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787892910.568682:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90710153bc00/0x825e3f5022b4a47d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a476 expref: 19 pid: 5842 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892910.568693:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90710153bc00/0x825e3f5022b4a47d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x825e3f5022b4a476 expref: 19 pid: 5842 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892910.568710:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9071421faa00/0x825e3f5022b4a708 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892910.568720:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9071421faa00/0x825e3f5022b4a708 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892910.568958:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9071421faa00/0x825e3f5022b4a708 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892910.568966:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9071421faa00/0x825e3f5022b4a708 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892910.568972:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9071421faa00/0x825e3f5022b4a708 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892910.568987:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9071421faa00/0x825e3f5022b4a708 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892910.568993:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421faa00 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:3.0:1787892910.568997:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9071421faa00/0x825e3f5022b4a708 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892910.569004:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9071421faa00/0x825e3f5022b4a708 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892910.569013:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9071421faa00/0x825e3f5022b4a708 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892910.569023:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787892910.569073:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107e83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22d910cf-711e-44e0-9acf-212404ada550+19:3308:x1874741455520384:12345-0@lo:103:ldlm_bl.0 Request processed in 401us (722us total) trans 0 rc 0/0 00010000:00010000:1.0:1787892910.569216:0:8519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907100030c00/0x825e3f5022b4a5aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x825e3f5022b4a5a3 expref: 19 pid: 5842 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892910.569232:0:8519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e629f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8519:1874741455519744:0@lo:104: 00010000:00010000:1.0:1787892910.569271:0:8519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9071421fa600/0x825e3f5022b4a4df lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x825e3f5022b4a4d8 expref: 18 pid: 5843 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892910.569281:0:8519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e628380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8519:1874741455519872:0@lo:104: 00010000:00010000:1.0:1787892910.569292:0:8519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90710153bc00/0x825e3f5022b4a47d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x825e3f5022b4a476 expref: 17 pid: 5842 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892910.569302:0:8519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9071083a3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8519:1874741455520000:0@lo:104: 00010000:00010000:1.0:1787892910.569318:0:8519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90710153b000/0x825e3f5022b4a667 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821adc7 expref: 9 pid: 5841 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892910.569326:0:8519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e628e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8519:1874741455519616:192.168.202.29@tcp:104: 00010000:00010000:1.0:1787892910.569353:0:8519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9071421faa00/0x825e3f5022b4a708 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892910.569363:0:8519:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9071421faa00/0x825e3f5022b4a708 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892910.569369:0:8519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9071421faa00/0x825e3f5022b4a708 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892910.569382:0:8519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9071421faa00/0x825e3f5022b4a708 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892910.569795:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22d910cf-711e-44e0-9acf-212404ada550:3308:1874741455520384:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787892910.573238:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 10000000:01000000:0.0:1787892910.937339:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787892910.937348:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9071072cc000 from 4 10000000:01000000:0.0:1787892910.937353:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787892910.937406:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff907103f07800/0x825e3f5022b4a70f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892910.937419:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff907103f07800/0x825e3f5022b4a70f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892910.937458:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff907103f07800/0x825e3f5022b4a70f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892910.937488:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455520512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787892910.937573:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892910.939667:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455520512 00000100:00100000:3.0:1787892910.939685:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455520512 00000100:00100000:3.0:1787892910.939799:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787892910.939810:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+16:5846:x1874741455520512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787892910.939828:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787892910.939849:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907104f47c00/0x825e3f5022b4a716 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4a70f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892910.939877:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907104f47c00/0x825e3f5022b4a716 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4a70f expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892910.939889:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907104f47c00/0x825e3f5022b4a716 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a70f expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892910.939912:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907104f47c00, rc 0) 00000100:00100000:3.0:1787892910.939982:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+17:5846:x1874741455520512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (2419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892910.939989:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787892910.940709:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710828dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787892910.940740:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455520512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787892910.940774:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff907103f07800/0x825e3f5022b4a70f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a716 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892910.940784:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff907103f07800/0x825e3f5022b4a70f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a716 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892910.940863:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455520640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787892910.940903:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892910.941237:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710828dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787892910.946011:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455520640 00000100:00100000:1.0:1787892910.946034:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455520640 00000100:00100000:1.0:1787892910.946114:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787892910.946125:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+17:5846:x1874741455520640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787892910.947957:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+17:5846:x1874741455520640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1826us (7045us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892910.947971:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787892910.948159:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455520640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787892910.948221:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455520768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787892910.948284:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892910.948326:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710828dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787892910.948394:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455520768 00000100:00100000:2.0:1787892910.948401:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455520768 00000100:00100000:2.0:1787892910.948445:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787892910.948453:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+17:5846:x1874741455520768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787892910.948667:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+17:5846:x1874741455520768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 214us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892910.948674:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787892910.948907:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455520768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787892910.950016:0:8532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8532:1874741455520896:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787892910.950076:0:8532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892910.950118:0:8532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071055bf840 going to sleep for 11 seconds 00000100:00100000:1.0:1787892910.951702:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455520896 00000100:00100000:1.0:1787892910.951717:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455520896 00000100:00100000:1.0:1787892910.951815:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787892910.951826:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+17:8532:x1874741455520896:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787892910.952100:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+17:8532:x1874741455520896:12345-0@lo:502:llog_process_th.0 Request processed in 275us (2023us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892910.952108:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787892910.952311:0:8532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8532:1874741455520896:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787892910.952355:0:8532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787892910.952366:0:8532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787892910.952368:0:8532:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787892910.952374:0:8532:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9071072cc000 00000020:00000080:0.0:1787892910.952377:0:8532:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787892910.952483:0:8532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8532:1874741455521024:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787892910.952537:0:8532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892910.952581:0:8532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071055bf840 going to sleep for 11 seconds 00000100:00100000:2.0:1787892910.954154:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455521024 00000100:00100000:2.0:1787892910.954166:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455521024 00000100:00100000:2.0:1787892910.954223:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787892910.954232:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+17:8532:x1874741455521024:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787892910.954459:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+17:8532:x1874741455521024:12345-0@lo:502:llog_process_th.0 Request processed in 227us (1932us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892910.954467:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787892910.955985:0:8532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8532:1874741455521024:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787892910.956034:0:8532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787892910.956045:0:8532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787892910.956047:0:8532:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787892910.956051:0:8532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787892910.956981:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787892910.957005:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787892910.957017:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff907103f07800/0x825e3f5022b4a70f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a716 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892910.957029:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff907103f07800/0x825e3f5022b4a70f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a716 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892910.957040:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787892910.957043:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff907105af0000 from 4 10000000:01000000:2.0:1787892910.957046:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787892910.957084:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9071102b9c00/0x825e3f5022b4a71d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892910.957092:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9071102b9c00/0x825e3f5022b4a71d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892910.957114:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9071102b9c00/0x825e3f5022b4a71d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892910.957138:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e80700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455521152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787892910.957203:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892910.957241:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710821f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787892910.957349:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455521152 00000100:00100000:0.0:1787892910.957356:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455521152 00000100:00100000:0.0:1787892910.957399:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787892910.957407:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+17:5846:x1874741455521152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787892910.957419:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787892910.957432:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907103f06800/0x825e3f5022b4a724 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4a71d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892910.957454:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907103f06800/0x825e3f5022b4a724 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4a71d expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892910.957464:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907103f06800/0x825e3f5022b4a724 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a71d expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892910.957473:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907103f06800, rc 0) 00000100:00100000:0.0:1787892910.957517:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+18:5846:x1874741455521152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892910.957537:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787892910.958095:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e80700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455521152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787892910.958114:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9071102b9c00/0x825e3f5022b4a71d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a724 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892910.958123:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9071102b9c00/0x825e3f5022b4a71d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a724 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892910.958183:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e80700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455521280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787892910.958214:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892910.958249:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710821f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787892910.958307:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455521280 00000100:00100000:0.0:1787892910.958313:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455521280 00000100:00100000:0.0:1787892910.958348:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787892910.958357:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+18:5846:x1874741455521280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787892910.958636:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+18:5846:x1874741455521280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 279us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892910.958795:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787892910.959811:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e80700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455521280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787892910.959879:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e80700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455521408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787892910.959941:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892910.959983:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710821f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787892910.960405:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455521408 00000100:00100000:0.0:1787892910.960412:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455521408 00000100:00100000:0.0:1787892910.960452:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787892910.960461:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+18:5846:x1874741455521408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787892910.961074:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+18:5846:x1874741455521408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 611us (1130us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892910.961083:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787892910.961198:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e80700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455521408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787892910.963111:0:8534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e82a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8534:1874741455521536:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787892910.963180:0:8534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892910.963223:0:8534:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710821f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787892910.963963:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455521536 00000100:00100000:3.0:1787892910.963973:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455521536 00000100:00100000:3.0:1787892910.964017:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787892910.964027:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+18:8534:x1874741455521536:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787892910.964254:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+18:8534:x1874741455521536:12345-0@lo:502:llog_process_th.0 Request processed in 228us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892910.964262:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787892910.964411:0:8534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e82a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8534:1874741455521536:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787892910.964464:0:8534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787892910.964476:0:8534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787892910.964479:0:8534:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787892910.964488:0:8534:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff907105af0000 00000020:00000080:2.0:1787892910.964491:0:8534:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787892910.964588:0:8534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e82a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8534:1874741455521664:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787892910.964631:0:8534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892910.965422:0:8534:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710821f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787892910.966139:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455521664 00000100:00100000:0.0:1787892910.966148:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455521664 00000100:00100000:0.0:1787892910.966239:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787892910.966248:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+18:8534:x1874741455521664:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787892910.966483:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+18:8534:x1874741455521664:12345-0@lo:502:llog_process_th.0 Request processed in 235us (1852us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892910.966490:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787892910.966623:0:8534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e82a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8534:1874741455521664:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787892910.966665:0:8534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787892910.966673:0:8534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787892910.966675:0:8534:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787892910.966682:0:8534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787892910.966834:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787892910.966851:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787892910.966872:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9071102b9c00/0x825e3f5022b4a71d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a724 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892910.966883:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9071102b9c00/0x825e3f5022b4a71d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a724 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892910.966893:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787892910.966896:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90710510c800 from 4 10000000:01000000:2.0:1787892910.966898:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787892910.966925:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9071102b8200/0x825e3f5022b4a72b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892910.966933:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9071102b8200/0x825e3f5022b4a72b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892910.966954:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9071102b8200/0x825e3f5022b4a72b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892910.966974:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455521792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787892910.967008:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892910.967333:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710821f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787892910.967413:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455521792 00000100:00100000:3.0:1787892910.967418:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455521792 00000100:00100000:3.0:1787892910.967457:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787892910.967464:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+18:5846:x1874741455521792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787892910.967475:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787892910.967487:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907104f46000/0x825e3f5022b4a732 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4a72b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892910.967508:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907104f46000/0x825e3f5022b4a732 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4a72b expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892910.967518:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907104f46000/0x825e3f5022b4a732 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a72b expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892910.967536:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907104f46000, rc 0) 00000100:00100000:3.0:1787892910.967581:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+19:5846:x1874741455521792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892910.967588:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787892910.967844:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455521792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787892910.967858:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9071102b8200/0x825e3f5022b4a72b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a732 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892910.967923:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9071102b8200/0x825e3f5022b4a72b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a732 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892910.967975:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455521920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787892910.968002:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892910.968029:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff90712c4cc540 going to sleep for 11 seconds 00000100:00100000:0.0:1787892910.968068:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455521920 00000100:00100000:0.0:1787892910.968073:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455521920 00000100:00100000:0.0:1787892910.968104:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787892910.968120:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+19:5846:x1874741455521920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787892910.968352:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+19:5846:x1874741455521920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 234us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892910.968359:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787892910.968422:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455521920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787892910.968461:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455522048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787892910.968498:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892910.968519:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff90712c4cc540 going to sleep for 11 seconds 00000100:00100000:2.0:1787892910.968621:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455522048 00000100:00100000:2.0:1787892910.968626:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455522048 00000100:00100000:2.0:1787892910.968996:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787892910.969006:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+19:5846:x1874741455522048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787892910.969149:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+19:5846:x1874741455522048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892910.969156:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787892910.969260:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455522048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787892910.977052:0:8535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8535:1874741455522176:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787892910.977124:0:8535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892910.977166:0:8535:0:(client.c:2715:ptlrpc_set_wait()) set ffff90712c4cc540 going to sleep for 11 seconds 00000100:00100000:1.0:1787892910.977179:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455522176 00000100:00100000:1.0:1787892910.977187:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455522176 00000100:00100000:1.0:1787892910.977242:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787892910.977251:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+19:8535:x1874741455522176:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787892910.979043:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+19:8535:x1874741455522176:12345-0@lo:502:llog_process_th.0 Request processed in 1784us (1909us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892910.979057:0:8535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8535:1874741455522176:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787892910.979057:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000020:01000000:3.0:1787892910.979101:0:8535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787892910.979118:0:8535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787892910.979121:0:8535:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787892910.979128:0:8535:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90710510c800 00000020:00000080:3.0:1787892910.979131:0:8535:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787892910.979228:0:8535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8535:1874741455522304:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787892910.979279:0:8535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892910.979330:0:8535:0:(client.c:2715:ptlrpc_set_wait()) set ffff90712c4cc540 going to sleep for 11 seconds 00000100:00100000:1.0:1787892910.979889:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455522304 00000100:00100000:1.0:1787892910.979903:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455522304 00000100:00100000:1.0:1787892910.979942:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787892910.979951:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+19:8535:x1874741455522304:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787892910.980152:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+19:8535:x1874741455522304:12345-0@lo:502:llog_process_th.0 Request processed in 202us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892910.980157:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787892910.982790:0:8535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:8535:1874741455522304:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787892910.982832:0:8535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787892910.982840:0:8535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787892910.982842:0:8535:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787892910.982847:0:8535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787892910.983970:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787892910.983997:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787892910.984009:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9071102b8200/0x825e3f5022b4a72b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a732 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892910.984022:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9071102b8200/0x825e3f5022b4a72b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a732 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892911.178187:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787892911.412677:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892911.412943:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431375616 00000100:00100000:3.0:1787892911.412953:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431375616 00000100:00100000:2.0:1787892911.413101:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 185 00000100:00100000:2.0:1787892911.413114:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907113ea9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+9:5604:x1874741431375616:12345-192.168.202.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787892911.413133:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787892911.413150:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9071102b9600/0x825e3f5022b4a739 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821ae06 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892911.413192:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9071102b9600/0x825e3f5022b4a739 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae06 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892911.413202:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9071102b9600/0x825e3f5022b4a739 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae06 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892911.413211:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071102b9600, rc 0) 00000100:00100000:2.0:1787892911.413301:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907113ea9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+10:5604:x1874741431375616:12345-192.168.202.29@tcp:101:ll_cfg_requeue.0 Request processed in 189us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892911.413308:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 185 00000100:00100000:3.0:1787892911.425219:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787892911.425338:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431375744 00000100:00100000:0.0:1787892911.425350:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431375744 00000100:00100000:0.0:1787892911.425413:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 186 00000100:00100000:0.0:1787892911.425425:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907119795450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+10:5604:x1874741431375744:12345-192.168.202.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787892911.425868:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907119795450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+10:5604:x1874741431375744:12345-192.168.202.29@tcp:501:ll_cfg_requeue.0 Request processed in 443us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892911.425879:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 186 00000100:00100000:3.0:1787892911.431924:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787892911.432040:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431375872 00000100:00100000:2.0:1787892911.432051:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431375872 00000100:00100000:2.0:1787892911.432116:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 187 00000100:00100000:2.0:1787892911.432129:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907119795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+10:5604:x1874741431375872:12345-192.168.202.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787892911.432378:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907119795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+10:5604:x1874741431375872:12345-192.168.202.29@tcp:503:ll_cfg_requeue.0 Request processed in 250us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892911.432386:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 187 00000100:00100000:3.0:1787892911.446726:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787892911.446879:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431376000 00000100:00100000:1.0:1787892911.446891:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431376000 00000100:00100000:1.0:1787892911.446968:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 188 00000100:00100000:1.0:1787892911.446981:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907119794050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+10:6132:x1874741431376000:12345-192.168.202.29@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787892911.447307:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907119794050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+10:6132:x1874741431376000:12345-192.168.202.29@tcp:502:llog_process_th.0 Request processed in 328us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892911.447315:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 188 00000100:00100000:3.0:1787892911.463003:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787892911.463202:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431376128 00000100:00100000:1.0:1787892911.463214:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431376128 00000100:00100000:1.0:1787892911.463279:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 189 00000100:00100000:1.0:1787892911.463291:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907106340050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+10:6132:x1874741431376128:12345-192.168.202.29@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787892911.464637:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907106340050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+10:6132:x1874741431376128:12345-192.168.202.29@tcp:502:llog_process_th.0 Request processed in 1338us (1633us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892911.464648:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 189 00000100:00100000:1.0:1787892911.822008:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787892911.822034:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455522432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787892911.822187:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892911.822335:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455522432 00000100:00100000:0.0:1787892911.822344:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455522432 00000100:00100000:0.0:1787892911.822409:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787892911.822420:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071083a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455522432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787892911.822455:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787892911.822503:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071083a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455522432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892911.822511:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1787892911.822551:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff907107e82680 x1874741455522432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892927 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892911.822582:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455522432:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787892911.822643:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787892912.182691:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787892912.182739:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787892912.182786:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787892912.182812:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787892912.182844:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431376384 00000100:00100000:1.0:1787892912.182855:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431376384 00000100:00100000:1.0:1787892912.182921:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 30 00000100:00100000:1.0:1787892912.182932:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071083a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+6:2360:x1874741431376384:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1787892912.183005:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071083a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+6:2360:x1874741431376384:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 76us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892912.183013:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 30 00000100:00100000:1.0:1787892912.183038:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431376256 00000100:00100000:1.0:1787892912.183041:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431376256 00000100:00100000:1.0:1787892912.183064:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 190 00000100:00100000:1.0:1787892912.183071:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907106341c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+10:2361:x1874741431376256:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1787892912.183098:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907106341c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+10:2361:x1874741431376256:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 27us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892912.183105:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 190 00000100:00100000:1.0:1787892912.183132:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431376640 00000100:00100000:1.0:1787892912.183136:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431376640 00000100:00100000:1.0:1787892912.183160:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431376512 00000100:00100000:1.0:1787892912.183163:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431376512 00000100:00100000:1.0:1787892912.183183:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 14 00000100:00100000:1.0:1787892912.183190:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071083a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4829748d-dde1-497a-9623-0e4326f0972c+5:2360:x1874741431376640:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1787892912.183217:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071083a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4829748d-dde1-497a-9623-0e4326f0972c+5:2360:x1874741431376640:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 27us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892912.183225:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 14 00000100:00100000:1.0:1787892912.183245:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 15 00000100:00100000:1.0:1787892912.183252:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071083a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4829748d-dde1-497a-9623-0e4326f0972c+5:2361:x1874741431376512:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1787892912.183277:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071083a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4829748d-dde1-497a-9623-0e4326f0972c+5:2361:x1874741431376512:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 25us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892912.183282:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 15 00000100:00080000:1.0:1787892912.183301:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787892912.183305:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787892912.183307:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787892912.201912:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787892912.845134:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874741455522816:0@lo:400:kworker.0 00000100:00100000:0.0:1787892912.845251:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892912.845324:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787892912.845349:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455522944:0@lo:400:kworker.0 00000100:00100000:0.0:1787892912.845379:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892912.845427:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455522944 00000100:00100000:0.0:1787892912.845435:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455522944 00000100:00100000:0.0:1787892912.845493:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787892912.845504:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455522944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787892912.845582:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455522944:12345-0@lo:400:kworker.0 Request processed in 80us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892912.845590:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1787892912.845735:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90712e2f2a00 x1874741455522944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892912.845772:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455522944:0@lo:400:kworker.0 00000100:00100000:1.0:1787892912.848368:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455522816 00000100:00100000:1.0:1787892912.848388:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455522816 00000100:00100000:1.0:1787892912.848475:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787892912.848486:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874741455522816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787892912.848606:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874741455522816:12345-0@lo:400:kworker.0 Request processed in 122us (3354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892912.848625:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787892912.848684:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874741455522816:0@lo:400:kworker.0 00000100:00080000:0.0:1787892912.848944:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787892912.852063:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455522560:0@lo:400:kworker.0 00000100:00100000:2.0:1787892912.852146:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892912.852200:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874741455523072:0@lo:400:kworker.0 00000100:00100000:2.0:1787892912.852228:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892912.852264:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787892912.852271:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874741455522688:0@lo:400:kworker.0 00000100:00100000:2.0:1787892912.852295:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892912.852328:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455523200:0@lo:400:kworker.0 00000100:00100000:2.0:1787892912.852355:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892912.852395:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455523072 00000100:00100000:2.0:1787892912.852405:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455523072 00000100:00100000:2.0:1787892912.852476:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455522688 00000100:00100000:2.0:1787892912.852479:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455522688 00000100:00100000:2.0:1787892912.852505:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787892912.852515:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107e83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874741455523072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787892912.852584:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107e83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874741455523072:12345-0@lo:400:kworker.0 Request processed in 70us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892912.852591:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787892912.852609:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787892912.852615:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107e80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874741455522688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787892912.852643:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107e80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874741455522688:12345-0@lo:400:kworker.0 Request processed in 28us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892912.852649:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787892912.852673:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455523200 00000100:00100000:2.0:1787892912.852677:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455523200 00000100:00100000:2.0:1787892912.852708:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787892912.852714:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107e82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455523200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787892912.852744:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107e82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455523200:12345-0@lo:400:kworker.0 Request processed in 30us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892912.852780:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1787892912.852798:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787892912.852803:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787892912.852835:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874741455522688:0@lo:400:kworker.0 00010000:00080000:2.0:1787892912.852850:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90712e2f3b80 x1874741455523200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892912.852869:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455523200:0@lo:400:kworker.0 00000100:00100000:2.0:1787892912.852881:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874741455523072:0@lo:400:kworker.0 00000100:00100000:1.0:1787892912.855439:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455522560 00000100:00100000:1.0:1787892912.855458:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455522560 00000100:00100000:1.0:1787892912.855527:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1787892912.855539:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907106342050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+19:3305:x1874741455522560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787892912.855654:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907106342050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+19:3305:x1874741455522560:12345-0@lo:400:kworker.0 Request processed in 117us (3507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892912.855661:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787892912.855842:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455522560:0@lo:400:kworker.0 00010000:00010000:3.0:1787892913.225799:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787892913.354264:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455523328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787892913.354355:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892913.355881:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455523328 00000100:00100000:0.0:1787892913.355893:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455523328 00000100:00100000:0.0:1787892913.355953:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787892913.355961:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071083a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455523328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787892913.355995:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787892913.356067:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071083a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455523328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (1713us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892913.356072:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1787892913.356139:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90712ebbe680 x1874741455523328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892929 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892913.356182:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455523328:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787892914.255490:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787892915.274249:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787892916.299407:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787892916.940267:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9071083a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455523456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787892916.940351:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892916.940553:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455523456 00000100:00100000:2.0:1787892916.940562:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455523456 00000100:00100000:2.0:1787892916.940631:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787892916.940640:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455523456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787892916.940674:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787892916.940715:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455523456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892916.940722:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1787892916.940786:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787892916.940817:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9071083a2680 x1874741455523456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892932 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892916.940850:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9071083a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455523456:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1787892916.987532:0:8818:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg229-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:3.0:1787892917.302818:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892917.302859:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892917.302895:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892917.302913:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787892917.302988:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431377152 00000100:00100000:0.0:1787892917.302998:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431377152 00000100:00100000:0.0:1787892917.303055:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431377024 00000100:00100000:0.0:1787892917.303057:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431377024 00000100:00100000:0.0:1787892917.303076:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 18 00000100:00100000:0.0:1787892917.303085:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4829748d-dde1-497a-9623-0e4326f0972c+5:2360:x1874741431377152:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1787892917.303146:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4829748d-dde1-497a-9623-0e4326f0972c+5:2360:x1874741431377152:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 63us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892917.303151:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 18 00000100:00100000:0.0:1787892917.303165:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 19 00000100:00100000:0.0:1787892917.303169:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4829748d-dde1-497a-9623-0e4326f0972c+5:2361:x1874741431377024:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1787892917.303183:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4829748d-dde1-497a-9623-0e4326f0972c+5:2361:x1874741431377024:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 14us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892917.303187:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 19 00000100:00100000:1.0:1787892917.303348:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431376768 00000100:00100000:1.0:1787892917.303353:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431376768 00000100:00100000:1.0:1787892917.303388:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 192 00000100:00100000:1.0:1787892917.303395:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+10:2361:x1874741431376768:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1787892917.303427:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+10:2361:x1874741431376768:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 33us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892917.303434:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 192 00000100:00080000:3.0:1787892917.303579:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787892917.303585:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787892917.303716:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431376896 00000100:00100000:2.0:1787892917.303722:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431376896 00000100:00100000:2.0:1787892917.303798:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 34 00000100:00100000:2.0:1787892917.303807:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+6:2360:x1874741431376896:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1787892917.303845:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+6:2360:x1874741431376896:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 40us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892917.303851:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 34 00000100:00080000:3.0:1787892917.304611:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787892917.320935:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787892917.961206:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9071083a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455523584:0@lo:400:kworker.0 00000100:00100000:1.0:1787892917.961291:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892917.961342:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9071083a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874741455524096:0@lo:400:kworker.0 00000100:00100000:1.0:1787892917.961376:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892917.961402:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787892917.961408:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9071083a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874741455523712:0@lo:400:kworker.0 00000100:00100000:1.0:1787892917.961430:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892917.961446:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9071083a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455524224:0@lo:400:kworker.0 00000100:00100000:1.0:1787892917.961669:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892917.961704:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9071083a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874741455523840:0@lo:400:kworker.0 00000100:00100000:1.0:1787892917.961728:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892917.961748:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787892917.961773:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9071083a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455523968:0@lo:400:kworker.0 00000100:00100000:1.0:1787892917.961795:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892917.962244:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455523584 00000100:00100000:2.0:1787892917.962253:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455523584 00000100:00100000:2.0:1787892917.962308:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787892917.962318:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+19:3305:x1874741455523584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787892917.962381:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+19:3305:x1874741455523584:12345-0@lo:400:kworker.0 Request processed in 64us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892917.962389:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787892917.972937:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455524224 00000100:00100000:2.0:1787892917.972954:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455524224 00000100:00100000:2.0:1787892917.973124:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455523968 00000100:00100000:2.0:1787892917.973129:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455523968 00000100:00100000:2.0:1787892917.973152:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787892917.973162:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071083a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455524224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787892917.973258:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071083a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455524224:12345-0@lo:400:kworker.0 Request processed in 98us (11588us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892917.973265:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787892917.973352:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787892917.973359:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071083a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455523968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787892917.973416:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071083a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455523968:12345-0@lo:400:kworker.0 Request processed in 58us (11620us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892917.973422:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787892917.973443:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455524096 00000100:00100000:2.0:1787892917.973447:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455524096 00010000:00080000:0.0:1787892917.974969:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9071083a1500 x1874741455523968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892917.974986:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9071083a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455523968:0@lo:400:kworker.0 00010000:00080000:0.0:1787892917.975075:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9071083a2300 x1874741455524224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892917.975085:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9071083a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455524224:0@lo:400:kworker.0 00000100:00100000:0.0:1787892917.975094:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9071083a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455523584:0@lo:400:kworker.0 00000100:00080000:3.0:1787892917.982056:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787892917.982066:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787892917.982985:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455523712 00000100:00100000:2.0:1787892917.983005:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455523712 00000100:00100000:2.0:1787892917.983024:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455523840 00000100:00100000:2.0:1787892917.983027:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455523840 00000100:00100000:1.0:1787892917.984332:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787892917.984348:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071083a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874741455524096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787892917.984473:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071083a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874741455524096:12345-0@lo:400:kworker.0 Request processed in 129us (23096us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892917.984481:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787892917.984512:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787892917.984519:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071083a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874741455523712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787892917.984557:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071083a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874741455523712:12345-0@lo:400:kworker.0 Request processed in 39us (23126us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892917.984563:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787892917.984607:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9071083a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874741455523712:0@lo:400:kworker.0 00000100:00100000:1.0:1787892917.984620:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9071083a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874741455524096:0@lo:400:kworker.0 00000100:00080000:3.0:1787892917.986154:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787892917.987527:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787892917.987542:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071083a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874741455523840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787892917.987828:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071083a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874741455523840:12345-0@lo:400:kworker.0 Request processed in 290us (26097us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892917.987836:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787892917.987941:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9071083a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874741455523840:0@lo:400:kworker.0 00010000:00010000:3.0:1787892918.348921:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787892918.478506:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455524352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787892918.478590:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892918.478782:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455524352 00000100:00100000:1.0:1787892918.478792:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455524352 00000100:00100000:1.0:1787892918.478843:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787892918.478852:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107e82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455524352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787892918.478887:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787892918.483383:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107e82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455524352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4520us (4782us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892918.483398:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1787892918.484919:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90712ebbf100 x1874741455524352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892934 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892918.484956:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455524352:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787892919.369233:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787892920.397408:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787892921.423803:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787892922.058393:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9071083a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455524480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787892922.058474:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892922.058550:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455524480 00000100:00100000:1.0:1787892922.058557:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455524480 00000100:00100000:1.0:1787892922.058612:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787892922.058630:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071083a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455524480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787892922.058668:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787892922.058712:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071083a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455524480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892922.058719:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1787892922.058740:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787892922.058952:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9071083a0380 x1874741455524480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892938 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892922.058974:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9071083a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455524480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787892922.419168:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892922.419218:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892922.419252:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431377408 00000100:00100000:3.0:1787892922.419261:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431377408 00000100:00100000:3.0:1787892922.419324:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 38 00000100:00100000:3.0:1787892922.419335:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+6:2361:x1874741431377408:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1787892922.419338:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431377280 00000100:00100000:0.0:1787892922.419345:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431377280 00000100:00100000:0.0:1787892922.419385:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 194 00000100:00100000:0.0:1787892922.419393:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+10:2361:x1874741431377280:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1787892922.419419:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+6:2361:x1874741431377408:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 86us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892922.419429:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 38 00000100:00100000:0.0:1787892922.419434:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+10:2361:x1874741431377280:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 40us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892922.419442:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 194 00000100:00080000:3.0:1787892922.419467:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787892922.429179:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787892922.429500:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431377536 00000100:00100000:2.0:1787892922.429510:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431377536 00000100:00080000:3.0:1787892922.429560:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787892922.429587:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 10 00000100:00100000:2.0:1787892922.429598:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4829748d-dde1-497a-9623-0e4326f0972c+5:2359:x1874741431377536:12345-192.168.202.29@tcp:9:kworker.0 00000020:00000080:2.0:1787892922.429634:0:6701:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x825e3f5022b4a675 00000100:00080000:2.0:1787892922.429655:0:6701:0:(import.c:65:import_set_state_nolock()) ffff907139bb5800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787892922.429701:0:6701:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1787892922.430064:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4829748d-dde1-497a-9623-0e4326f0972c+2:2359:x1874741431377536:12345-192.168.202.29@tcp:9:kworker.0 Request processed in 466us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892922.430072:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 10 00010000:00010000:3.0:1787892922.430532:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787892922.430661:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787892922.431773:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431377664 00000100:00100000:1.0:1787892922.431784:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431377664 00000100:00100000:1.0:1787892922.431842:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 11 00000100:00100000:1.0:1787892922.431855:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107e80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4829748d-dde1-497a-9623-0e4326f0972c+5:2359:x1874741431377664:12345-192.168.202.29@tcp:9:kworker.0 00000020:00000080:1.0:1787892922.431893:0:6702:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x825e3f5022b4a67c 00000100:00080000:1.0:1787892922.431905:0:6702:0:(import.c:65:import_set_state_nolock()) ffff907139bb6800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787892922.431936:0:6702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787892922.432251:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107e80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4829748d-dde1-497a-9623-0e4326f0972c+2:2359:x1874741431377664:12345-192.168.202.29@tcp:9:kworker.0 Request processed in 398us (1591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892922.432259:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 11 00010000:00010000:1.0:1787892922.432308:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787892922.432405:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787892922.441925:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787892922.579167:0:9061:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg229-server.virtnet: executing yml_node 00000100:00100000:3.0:1787892923.088416:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455524608:0@lo:400:kworker.0 00000100:00100000:3.0:1787892923.088502:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892923.088562:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700389bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874741455525120:0@lo:400:kworker.0 00000100:00100000:3.0:1787892923.088587:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892923.088608:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787892923.088612:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874741455524736:0@lo:400:kworker.0 00000100:00100000:3.0:1787892923.088623:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892923.088642:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907003898e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455525248:0@lo:400:kworker.0 00000100:00100000:3.0:1787892923.088664:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892923.088694:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907003898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874741455524864:0@lo:400:kworker.0 00000100:00100000:3.0:1787892923.088714:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892923.088727:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787892923.088731:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700389b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455524992:0@lo:400:kworker.0 00000100:00100000:3.0:1787892923.088743:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892923.088782:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455524608 00000100:00100000:3.0:1787892923.088788:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455524608 00000100:00100000:3.0:1787892923.088827:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1787892923.088833:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+19:3305:x1874741455524608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787892923.088881:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+19:3305:x1874741455524608:12345-0@lo:400:kworker.0 Request processed in 47us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892923.088890:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1787892923.088927:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455525120 00000100:00100000:3.0:1787892923.088930:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455525120 00000100:00100000:3.0:1787892923.088958:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455524736 00000100:00100000:3.0:1787892923.088960:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455524736 00000100:00100000:3.0:1787892923.088970:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455524864 00000100:00100000:3.0:1787892923.088972:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455524864 00000100:00100000:3.0:1787892923.088981:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787892923.088985:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90700389a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874741455525120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787892923.089008:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90700389a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874741455525120:12345-0@lo:400:kworker.0 Request processed in 24us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892923.089013:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787892923.089020:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787892923.089023:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90700389aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874741455524736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787892923.089048:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90700389aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874741455524736:12345-0@lo:400:kworker.0 Request processed in 24us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892923.089052:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787892923.089061:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787892923.089066:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907003899880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874741455524864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787892923.089095:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907003899880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874741455524864:12345-0@lo:400:kworker.0 Request processed in 28us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892923.089100:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787892923.089120:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455525248 00000100:00100000:3.0:1787892923.089123:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455525248 00000100:00100000:3.0:1787892923.089149:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455524992 00000100:00100000:3.0:1787892923.089152:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455524992 00000100:00100000:3.0:1787892923.089170:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787892923.089176:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907003899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455525248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787892923.089390:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907003899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455525248:12345-0@lo:400:kworker.0 Request processed in 213us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892923.089397:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787892923.089409:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787892923.089416:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907003899500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455524992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787892923.089443:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907003899500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455524992:12345-0@lo:400:kworker.0 Request processed in 28us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892923.089448:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1787892923.089478:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787892923.089482:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787892923.089520:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90700389b480 x1874741455524992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892923.090315:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700389b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455524992:0@lo:400:kworker.0 00000100:00100000:3.0:1787892923.090343:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907003898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874741455524864:0@lo:400:kworker.0 00000100:00100000:3.0:1787892923.090387:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874741455524736:0@lo:400:kworker.0 00010000:00080000:3.0:1787892923.090400:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff907003898e00 x1874741455525248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892923.090411:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907003898e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455525248:0@lo:400:kworker.0 00000100:00100000:3.0:1787892923.090422:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455524608:0@lo:400:kworker.0 00000100:00100000:3.0:1787892923.090432:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700389bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874741455525120:0@lo:400:kworker.0 00000001:00100000:1.0:1787892923.192804:0:6725:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4829748d-dde1-497a-9623-0e4326f0972c 00000020:00000080:1.0:1787892923.192815:0:6725:0:(genops.c:885:class_export_put()) final put ffff907139bb3000/4829748d-dde1-497a-9623-0e4326f0972c 00000020:00000080:1.0:1787892923.192847:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff907139bb3000/4829748d-dde1-497a-9623-0e4326f0972c for lustre-OST0000 00000020:00000080:1.0:1787892923.192907:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff907139bb5800 for lustre-OST0000 00010000:00010000:3.0:1787892923.465405:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787892923.600905:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455525376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787892923.600982:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892923.601074:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455525376 00000100:00100000:2.0:1787892923.601082:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455525376 00000100:00100000:2.0:1787892923.601145:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787892923.601155:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455525376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787892923.601190:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787892923.601233:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455525376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892923.601240:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1787892923.601276:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9070038c2300 x1874741455525376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892939 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892923.601294:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455525376:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787892924.489012:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892925.514610:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787892926.546215:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787892927.195545:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455525504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787892927.195657:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892927.195808:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455525504 00000100:00100000:2.0:1787892927.195818:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455525504 00000100:00100000:2.0:1787892927.195896:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787892927.195907:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455525504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787892927.195955:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787892927.196010:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455525504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892927.196018:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1787892927.196042:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787892927.196084:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9070038c2300 x1874741455525504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892943 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892927.196106:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455525504:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1787892927.211476:0:9254:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.84 00000001:00100000:3.0:1787892927.281274:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4829748d-dde1-497a-9623-0e4326f0972c 00000020:00000080:3.0:1787892927.281288:0:7656:0:(genops.c:885:class_export_put()) final put ffff907139bb0800/4829748d-dde1-497a-9623-0e4326f0972c 00000020:00000080:0.0:1787892927.281897:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff907139bb0800/4829748d-dde1-497a-9623-0e4326f0972c for lustre-OST0001 00000020:00000080:0.0:1787892927.281956:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff907139bb6800 for lustre-OST0001 00000100:00100000:2.0:1787892927.539089:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787892927.539220:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892927.539322:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431377920 00000100:00100000:3.0:1787892927.539336:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431377920 00000100:00100000:3.0:1787892927.539467:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 42 00000100:00100000:3.0:1787892927.539479:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+6:2362:x1874741431377920:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1787892927.539597:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+6:2362:x1874741431377920:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 119us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892927.539606:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 42 00000100:00080000:2.0:1787892927.540108:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787892927.540718:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431377792 00000100:00100000:0.0:1787892927.540733:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431377792 00000100:00100000:1.0:1787892927.541048:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 196 00000100:00100000:1.0:1787892927.541060:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+10:2362:x1874741431377792:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1787892927.541150:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+10:2362:x1874741431377792:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 92us (2078us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892927.541158:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 196 00010000:00010000:1.0:1787892927.562649:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787892928.201946:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700389bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455525632:0@lo:400:kworker.0 00000100:00100000:3.0:1787892928.202024:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892928.202073:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907003898380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874741455526144:0@lo:400:kworker.0 00000100:00100000:3.0:1787892928.202106:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892928.202150:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787892928.202157:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907003898e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874741455525760:0@lo:400:kworker.0 00000100:00100000:3.0:1787892928.202178:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892928.202193:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700389a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455526272:0@lo:400:kworker.0 00000100:00100000:3.0:1787892928.202224:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892928.202253:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907003898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874741455525888:0@lo:400:kworker.0 00000100:00100000:3.0:1787892928.202276:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892928.202293:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787892928.202298:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700389b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455526016:0@lo:400:kworker.0 00000100:00100000:3.0:1787892928.202317:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892928.202346:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455525632 00000100:00100000:3.0:1787892928.202354:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455525632 00000100:00100000:3.0:1787892928.202402:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1787892928.202424:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+19:3305:x1874741455525632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787892928.202478:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+19:3305:x1874741455525632:12345-0@lo:400:kworker.0 Request processed in 56us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892928.202485:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1787892928.202516:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455526144 00000100:00100000:3.0:1787892928.202521:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455526144 00000100:00100000:3.0:1787892928.202553:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455525760 00000100:00100000:3.0:1787892928.202556:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455525760 00000100:00100000:3.0:1787892928.202568:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455525888 00000100:00100000:3.0:1787892928.202570:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455525888 00000100:00100000:3.0:1787892928.202583:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787892928.202589:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90700389b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874741455526144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787892928.202621:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90700389b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874741455526144:12345-0@lo:400:kworker.0 Request processed in 32us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892928.202634:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787892928.202646:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787892928.202652:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907003899c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874741455525760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787892928.202680:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907003899c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874741455525760:12345-0@lo:400:kworker.0 Request processed in 29us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892928.202686:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787892928.202697:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787892928.202703:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907003898a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874741455525888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787892928.202733:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907003898a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874741455525888:12345-0@lo:400:kworker.0 Request processed in 31us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892928.202738:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787892928.202781:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455526272 00000100:00100000:3.0:1787892928.202785:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455526272 00000100:00100000:3.0:1787892928.202809:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455526016 00000100:00100000:3.0:1787892928.202813:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455526016 00000100:00100000:3.0:1787892928.202829:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787892928.202834:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907003899f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455526272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787892928.202865:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907003899f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455526272:12345-0@lo:400:kworker.0 Request processed in 31us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892928.202872:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787892928.202883:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787892928.202889:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907003898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455526016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787892928.202916:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907003898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455526016:12345-0@lo:400:kworker.0 Request processed in 28us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892928.202922:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1787892928.202956:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787892928.202962:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787892928.203002:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90700389b480 x1874741455526016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892928.203017:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700389b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455526016:0@lo:400:kworker.0 00000100:00100000:3.0:1787892928.203029:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907003898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874741455525888:0@lo:400:kworker.0 00000100:00100000:3.0:1787892928.203064:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907003898e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874741455525760:0@lo:400:kworker.0 00010000:00080000:3.0:1787892928.203075:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90700389a300 x1874741455526272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892928.203082:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700389a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455526272:0@lo:400:kworker.0 00000100:00100000:3.0:1787892928.203090:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700389bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455525632:0@lo:400:kworker.0 00000100:00100000:3.0:1787892928.203098:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907003898380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874741455526144:0@lo:400:kworker.0 00010000:00010000:1.0:1787892928.584931:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787892928.713265:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455526400:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787892928.713345:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892928.713575:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455526400 00000100:00100000:2.0:1787892928.713585:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455526400 00000100:00100000:2.0:1787892928.713700:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787892928.713712:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907003898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455526400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787892928.713783:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787892928.714835:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907003898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455526400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1041us (1405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892928.714848:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1787892928.717306:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90712e2f2a00 x1874741455526400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892944 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892928.717334:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455526400:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787892929.609213:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787892930.088157:0:9353:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.84 00010000:00010000:0.0:1787892930.641102:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892931.660352:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787892932.309411:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455526528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787892932.309488:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892932.311375:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455526528 00000100:00100000:0.0:1787892932.311393:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455526528 00000100:00100000:0.0:1787892932.311473:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787892932.311485:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455526528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787892932.311531:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787892932.311608:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455526528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (2120us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892932.311615:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1787892932.311659:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90712e2f2a00 x1874741455526528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892948 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892932.311699:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455526528:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787892932.311844:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787892932.660714:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787892932.660846:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431378048 00000100:00100000:1.0:1787892932.660857:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431378048 00000100:00100000:1.0:1787892932.660925:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 198 00000100:00100000:1.0:1787892932.660936:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+10:2362:x1874741431378048:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1787892932.661019:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+10:2362:x1874741431378048:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 84us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892932.661031:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 198 00000100:00100000:2.0:1787892932.666079:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892932.666156:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431378176 00000100:00100000:3.0:1787892932.666166:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431378176 00000100:00100000:3.0:1787892932.666232:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 46 00000100:00100000:3.0:1787892932.666241:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+6:2363:x1874741431378176:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1787892932.666316:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+6:2363:x1874741431378176:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 75us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892932.666335:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 46 00000100:00080000:2.0:1787892932.666548:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787892932.680987:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787892932.935823:0:9450:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.84 00000100:00100000:1.0:1787892933.320941:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700389a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874741455526784:0@lo:400:kworker.0 00000100:00100000:1.0:1787892933.321031:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892933.321108:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700389ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455527296:0@lo:400:kworker.0 00000100:00100000:1.0:1787892933.321137:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892933.321165:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787892933.321171:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700389bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22d910cf-711e-44e0-9acf-212404ada550:3306:1874741455526656:0@lo:400:kworker.0 00000100:00100000:1.0:1787892933.321201:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892933.321255:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700389b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874741455527168:0@lo:400:kworker.0 00000100:00100000:1.0:1787892933.321280:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892933.321281:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907003898e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874741455526912:0@lo:400:kworker.0 00000100:00100000:0.0:1787892933.321309:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892933.321310:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455527296 00000100:00100000:1.0:1787892933.321317:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455527296 00000100:00100000:0.0:1787892933.321342:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787892933.321347:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907003898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455527040:0@lo:400:kworker.0 00000100:00100000:1.0:1787892933.321386:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787892933.321397:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071083a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455527296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787892933.321410:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892933.321438:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455526784 00000100:00100000:0.0:1787892933.321442:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455526784 00000100:00100000:1.0:1787892933.321447:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071083a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455527296:12345-0@lo:400:kworker.0 Request processed in 52us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892933.321454:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787892933.321467:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455527168 00000100:00100000:0.0:1787892933.321469:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455527168 00000100:00100000:1.0:1787892933.321470:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455527040 00000100:00100000:1.0:1787892933.321472:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455527040 00000100:00100000:0.0:1787892933.321482:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455526912 00000100:00100000:0.0:1787892933.321484:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455526912 00000100:00100000:1.0:1787892933.321489:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787892933.321495:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455527040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787892933.321498:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787892933.321503:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071083a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874741455526784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787892933.321527:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455527040:12345-0@lo:400:kworker.0 Request processed in 32us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892933.321530:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071083a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874741455526784:12345-0@lo:400:kworker.0 Request processed in 28us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892933.321533:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787892933.321535:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787892933.321547:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787892933.321551:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455526656 00000100:00100000:0.0:1787892933.321553:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071083a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874741455527168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787892933.321554:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455526656 00000100:00100000:1.0:1787892933.321577:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1787892933.321578:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071083a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874741455527168:12345-0@lo:400:kworker.0 Request processed in 25us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892933.321583:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+19:3306:x1874741455526656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787892933.321583:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787892933.321593:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787892933.321598:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874741455526912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787892933.321610:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+19:3306:x1874741455526656:12345-0@lo:400:kworker.0 Request processed in 27us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892933.321617:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1787892933.321618:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874741455526912:12345-0@lo:400:kworker.0 Request processed in 20us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892933.321629:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1787892933.321643:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787892933.321648:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787892933.321773:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700389bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22d910cf-711e-44e0-9acf-212404ada550:3306:1874741455526656:0@lo:400:kworker.0 00000100:00100000:0.0:1787892933.321789:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700389b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874741455527168:0@lo:400:kworker.0 00010000:00080000:0.0:1787892933.321801:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90700389ad80 x1874741455527296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1787892933.321895:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff907003898000 x1874741455527040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892933.321918:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907003898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455527040:0@lo:400:kworker.0 00000100:00100000:1.0:1787892933.321932:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907003898e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874741455526912:0@lo:400:kworker.0 00000100:00100000:0.0:1787892933.322034:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700389ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455527296:0@lo:400:kworker.0 00000100:00100000:0.0:1787892933.322051:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700389a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874741455526784:0@lo:400:kworker.0 00010000:00010000:0.0:1787892933.705050:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787892933.833875:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787892933.839967:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455527424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787892933.840056:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892933.846799:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455527424 00000100:00100000:0.0:1787892933.849162:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455527424 00000100:00100000:0.0:1787892933.849256:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787892933.849268:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e62a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455527424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787892933.850062:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787892933.850166:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e62a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455527424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 898us (10107us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892933.850175:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1787892933.850349:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90712e2f1500 x1874741455527424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892949 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892933.850395:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455527424:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1787892934.635745:0:9499:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Aug 28 00:55:32 EDT 2026 00010000:00010000:2.0:1787892934.728871:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892935.753437:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892936.779580:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787892937.418011:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9071083a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455527552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787892937.418093:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892937.418184:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455527552 00000100:00100000:1.0:1787892937.418194:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455527552 00000100:00100000:1.0:1787892937.418259:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787892937.418272:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071083a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455527552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787892937.418336:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787892937.418385:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071083a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455527552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892937.418394:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1787892937.418415:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787892937.418442:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9071083a2a00 x1874741455527552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892953 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892937.418461:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9071083a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455527552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787892937.778493:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892937.778542:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892937.778570:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431378304 00000100:00100000:3.0:1787892937.778581:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431378304 00000100:00100000:3.0:1787892937.778636:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 200 00000100:00100000:3.0:1787892937.778657:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+10:2363:x1874741431378304:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1787892937.778738:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+10:2363:x1874741431378304:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 92us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892937.778745:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 200 00000100:00100000:3.0:1787892937.780008:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431378432 00000100:00100000:3.0:1787892937.780020:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431378432 00000100:00100000:3.0:1787892937.780124:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 50 00000100:00100000:3.0:1787892937.780133:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90700389b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+6:2363:x1874741431378432:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1787892937.780202:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90700389b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+6:2363:x1874741431378432:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 70us (1718us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892937.780208:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 50 00000100:00080000:2.0:1787892937.780339:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787892937.808969:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787892938.443393:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9071083a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455527680:0@lo:400:kworker.0 00000100:00100000:1.0:1787892938.443466:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892938.443512:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e5c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874741455528192:0@lo:400:kworker.0 00000100:00100000:1.0:1787892938.443535:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892938.443561:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787892938.443722:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9071083a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874741455527808:0@lo:400:kworker.0 00000100:00100000:1.0:1787892938.443748:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892938.443785:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e5c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455528320:0@lo:400:kworker.0 00000100:00100000:1.0:1787892938.443810:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892938.443842:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9071083a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874741455527936:0@lo:400:kworker.0 00000100:00100000:1.0:1787892938.443865:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892938.443884:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787892938.443889:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e5c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455528064:0@lo:400:kworker.0 00000100:00100000:1.0:1787892938.443908:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892938.443940:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455527680 00000100:00100000:1.0:1787892938.443948:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455527680 00000100:00100000:1.0:1787892938.443991:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1787892938.444000:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+19:3305:x1874741455527680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787892938.444050:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+19:3305:x1874741455527680:12345-0@lo:400:kworker.0 Request processed in 51us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892938.444058:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1787892938.444091:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455528192 00000100:00100000:1.0:1787892938.444095:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455528192 00000100:00100000:1.0:1787892938.444127:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455527808 00000100:00100000:1.0:1787892938.444130:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455527808 00000100:00100000:1.0:1787892938.444142:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455527936 00000100:00100000:1.0:1787892938.444145:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455527936 00000100:00100000:1.0:1787892938.444159:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787892938.444164:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e5c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874741455528192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787892938.444195:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e5c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874741455528192:12345-0@lo:400:kworker.0 Request processed in 30us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892938.444201:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787892938.444220:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787892938.444226:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e5c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874741455527808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787892938.444253:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e5c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874741455527808:12345-0@lo:400:kworker.0 Request processed in 27us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892938.444259:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787892938.444269:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787892938.444476:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e5c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874741455527936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787892938.444511:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e5c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874741455527936:12345-0@lo:400:kworker.0 Request processed in 236us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892938.444517:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787892938.444538:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455528320 00000100:00100000:1.0:1787892938.444541:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455528320 00000100:00100000:1.0:1787892938.444563:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455528064 00000100:00100000:1.0:1787892938.444837:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455528064 00000100:00100000:1.0:1787892938.444863:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787892938.444870:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e5c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455528320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787892938.444901:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e5c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455528320:12345-0@lo:400:kworker.0 Request processed in 32us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892938.444907:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787892938.444918:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787892938.444923:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e5c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455528064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787892938.444949:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e5c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455528064:12345-0@lo:400:kworker.0 Request processed in 26us (1040us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892938.444955:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1787892938.444980:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787892938.444985:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787892938.445018:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90712e5c1500 x1874741455528064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892938.445039:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e5c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455528064:0@lo:400:kworker.0 00000100:00100000:1.0:1787892938.445052:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9071083a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874741455527936:0@lo:400:kworker.0 00000100:00100000:1.0:1787892938.445083:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9071083a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874741455527808:0@lo:400:kworker.0 00010000:00080000:1.0:1787892938.445093:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90712e5c2300 x1874741455528320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892938.445101:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e5c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455528320:0@lo:400:kworker.0 00000100:00100000:1.0:1787892938.445111:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9071083a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455527680:0@lo:400:kworker.0 00000100:00100000:1.0:1787892938.445121:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e5c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874741455528192:0@lo:400:kworker.0 00010000:00010000:1.0:1787892938.825119:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787892938.953167:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787892938.953190:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455528448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787892938.953282:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892938.957658:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455528448 00000100:00100000:3.0:1787892938.957677:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455528448 00000100:00100000:3.0:1787892938.958714:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787892938.958741:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455528448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787892938.958932:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787892938.959049:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455528448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 320us (5765us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892938.959077:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1787892938.959178:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90712e2f1880 x1874741455528448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892954 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892938.959200:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455528448:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787892939.849148:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892940.885912:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892941.897204:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787892942.537052:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e5c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455528576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787892942.537124:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892942.537353:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455528576 00000100:00100000:1.0:1787892942.537360:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455528576 00000100:00100000:1.0:1787892942.537434:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787892942.537442:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90700389a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455528576:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787892942.537447:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1787892942.537472:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787892942.537528:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90700389a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455528576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892942.537535:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1787892942.537610:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90712e5c0380 x1874741455528576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892958 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892942.537633:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e5c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455528576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787892942.898709:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787892942.899030:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431378560 00000100:00100000:2.0:1787892942.899048:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431378560 00000100:00100000:2.0:1787892942.899119:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 202 00000100:00100000:2.0:1787892942.899132:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+10:2361:x1874741431378560:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1787892942.899590:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+10:2361:x1874741431378560:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 459us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892942.899608:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 202 00000100:00100000:3.0:1787892942.901976:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787892942.902139:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431378688 00000100:00100000:0.0:1787892942.902151:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431378688 00000100:00100000:0.0:1787892942.902268:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 54 00000100:00100000:0.0:1787892942.902400:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90700389ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+6:2361:x1874741431378688:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1787892942.902480:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90700389ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+6:2361:x1874741431378688:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 84us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892942.902489:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 54 00000100:00080000:2.0:1787892942.902711:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787892942.920924:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787892943.562042:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787892943.562066:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22d910cf-711e-44e0-9acf-212404ada550:3306:1874741455528704:0@lo:400:kworker.0 00000100:00100000:1.0:1787892943.562143:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892943.562194:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874741455528832:0@lo:400:kworker.0 00000100:00100000:2.0:1787892943.562212:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874741455529216:0@lo:400:kworker.0 00000100:00100000:2.0:1787892943.562250:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892943.562287:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787892943.562293:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455529344:0@lo:400:kworker.0 00000100:00100000:2.0:1787892943.562319:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892943.562346:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455529088:0@lo:400:kworker.0 00000100:00100000:2.0:1787892943.562371:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892943.562376:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874741455528960:0@lo:400:kworker.0 00000100:00100000:2.0:1787892943.562401:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455529216 00000100:00100000:3.0:1787892943.562404:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892943.562408:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455529216 00000100:00100000:2.0:1787892943.562454:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455528960 00000100:00100000:2.0:1787892943.562457:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455528960 00000100:00100000:2.0:1787892943.562475:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787892943.562483:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874741455529216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787892943.562536:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874741455529216:12345-0@lo:400:kworker.0 Request processed in 42us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892943.562543:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787892943.562559:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787892943.562565:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90700389b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874741455528960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787892943.562611:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90700389b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874741455528960:12345-0@lo:400:kworker.0 Request processed in 46us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892943.562617:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787892943.562633:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455529344 00000100:00100000:2.0:1787892943.562636:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455529344 00000100:00100000:2.0:1787892943.562657:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455529088 00000100:00100000:2.0:1787892943.562660:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455529088 00000100:00100000:2.0:1787892943.562673:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787892943.562678:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455529344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787892943.562701:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455529344:12345-0@lo:400:kworker.0 Request processed in 23us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892943.562707:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787892943.562715:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787892943.562719:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455529088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787892943.562741:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455529088:12345-0@lo:400:kworker.0 Request processed in 21us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892943.562747:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1787892943.562791:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787892943.562795:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787892943.562835:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874741455528960:0@lo:400:kworker.0 00010000:00080000:2.0:1787892943.562871:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90712ebc2d80 x1874741455529088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892943.562883:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455529088:0@lo:400:kworker.0 00010000:00080000:2.0:1787892943.562899:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90712ebc1c00 x1874741455529344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892943.562906:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455529344:0@lo:400:kworker.0 00000100:00100000:2.0:1787892943.562923:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874741455529216:0@lo:400:kworker.0 00000100:00100000:1.0:1787892943.563127:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892943.563167:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455528704 00000100:00100000:1.0:1787892943.563172:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455528704 00000100:00100000:1.0:1787892943.563200:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787892943.563206:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+19:3306:x1874741455528704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787892943.563242:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+19:3306:x1874741455528704:12345-0@lo:400:kworker.0 Request processed in 36us (1099us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892943.563248:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1787892943.563346:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455528832 00000100:00100000:0.0:1787892943.563351:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455528832 00000100:00100000:0.0:1787892943.563373:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787892943.563380:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e5c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874741455528832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787892943.563411:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e5c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874741455528832:12345-0@lo:400:kworker.0 Request processed in 33us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892943.563417:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787892943.563475:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874741455528832:0@lo:400:kworker.0 00000100:00100000:1.0:1787892943.563484:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22d910cf-711e-44e0-9acf-212404ada550:3306:1874741455528704:0@lo:400:kworker.0 00010000:00010000:1.0:1787892943.945790:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787892944.090725:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787892944.090782:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e5c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455529472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787892944.090881:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892944.090962:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455529472 00000100:00100000:3.0:1787892944.090972:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455529472 00000100:00100000:3.0:1787892944.091154:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787892944.091165:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455529472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787892944.091220:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787892944.091292:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455529472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892944.091300:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1787892944.091371:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90712e5c1500 x1874741455529472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892960 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892944.091393:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e5c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455529472:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787892944.969973:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892945.992928:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787892947.020996:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787892947.662696:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787892947.662728:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455529600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787892947.662870:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892947.663075:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455529600 00000100:00100000:1.0:1787892947.663085:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455529600 00000100:00100000:1.0:1787892947.663149:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787892947.663161:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e5c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455529600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787892947.663206:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787892947.663271:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e5c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455529600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892947.663279:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1787892947.663324:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90712e2f1500 x1874741455529600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892963 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892947.663348:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455529600:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787892947.663497:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787892948.024986:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787892948.025032:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787892948.025072:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431378944 00000100:00100000:1.0:1787892948.025081:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431378944 00000100:00100000:1.0:1787892948.025146:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 58 00000100:00100000:1.0:1787892948.025157:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e5c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+6:2363:x1874741431378944:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1787892948.025244:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e5c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+6:2363:x1874741431378944:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 89us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892948.025252:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 58 00000100:00080000:1.0:1787892948.025274:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787892948.026541:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431378816 00000100:00100000:2.0:1787892948.026552:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431378816 00000100:00100000:2.0:1787892948.026600:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 204 00000100:00100000:2.0:1787892948.026609:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+10:2363:x1874741431378816:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1787892948.026666:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+10:2363:x1874741431378816:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 59us (1633us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892948.026674:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 204 00010000:00010000:1.0:1787892948.044508:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787892948.681648:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700389bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455529728:0@lo:400:kworker.0 00000100:00100000:0.0:1787892948.681749:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892948.682156:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455529728 00000100:00100000:2.0:1787892948.682168:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455529728 00000100:00100000:2.0:1787892948.682455:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1787892948.682468:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+19:3305:x1874741455529728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787892948.682551:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+19:3305:x1874741455529728:12345-0@lo:400:kworker.0 Request processed in 85us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892948.682559:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1787892948.684604:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700389bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455529728:0@lo:400:kworker.0 00000100:00100000:3.0:1787892948.694025:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700389bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455530112:0@lo:400:kworker.0 00000100:00100000:3.0:1787892948.694126:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892948.694166:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787892948.694171:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907003898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874741455529984:0@lo:400:kworker.0 00000100:00100000:3.0:1787892948.694195:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892948.694237:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455530112 00000100:00100000:3.0:1787892948.694245:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455530112 00000100:00100000:3.0:1787892948.694315:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787892948.694325:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137f7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455530112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787892948.694400:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137f7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455530112:12345-0@lo:400:kworker.0 Request processed in 75us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892948.694408:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787892948.694431:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455529984 00000100:00100000:3.0:1787892948.694435:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455529984 00000100:00100000:3.0:1787892948.694473:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787892948.694479:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137f7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874741455529984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787892948.694511:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137f7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874741455529984:12345-0@lo:400:kworker.0 Request processed in 32us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892948.694517:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:3.0:1787892948.694540:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787892948.694578:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907003898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874741455529984:0@lo:400:kworker.0 00010000:00080000:3.0:1787892948.694594:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90700389bb80 x1874741455530112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892948.694604:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700389bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455530112:0@lo:400:kworker.0 00000100:00100000:0.0:1787892948.696063:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874741455530240:0@lo:400:kworker.0 00000100:00100000:0.0:1787892948.696140:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892948.696184:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787892948.696191:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907003898e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874741455529856:0@lo:400:kworker.0 00000100:00100000:0.0:1787892948.696243:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892948.697834:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455530368:0@lo:400:kworker.0 00000100:00100000:0.0:1787892948.697886:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892948.698133:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455530240 00000100:00100000:2.0:1787892948.698142:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455530240 00000100:00100000:2.0:1787892948.698208:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455529856 00000100:00100000:2.0:1787892948.698212:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455529856 00000100:00100000:2.0:1787892948.698248:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787892948.698268:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874741455530240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787892948.698329:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874741455530240:12345-0@lo:400:kworker.0 Request processed in 63us (2188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892948.698336:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787892948.698365:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787892948.698371:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874741455529856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787892948.698585:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874741455529856:12345-0@lo:400:kworker.0 Request processed in 213us (2340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892948.698592:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:0.0:1787892948.700037:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787892948.700099:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907003898e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874741455529856:0@lo:400:kworker.0 00000100:00100000:0.0:1787892948.700146:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874741455530240:0@lo:400:kworker.0 00000100:00100000:3.0:1787892948.702549:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455530368 00000100:00100000:3.0:1787892948.702569:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455530368 00000100:00100000:3.0:1787892948.702688:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787892948.702701:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455530368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787892948.702838:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455530368:12345-0@lo:400:kworker.0 Request processed in 140us (4951us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892948.702846:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1787892948.702900:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90712ebbf100 x1874741455530368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892948.702928:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455530368:0@lo:400:kworker.0 00000100:00080000:0.0:1787892948.703391:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787892949.064931:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787892949.194287:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e5c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455530496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787892949.194406:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892949.194465:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455530496 00000100:00100000:1.0:1787892949.194477:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455530496 00000100:00100000:1.0:1787892949.194545:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787892949.194555:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455530496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787892949.194602:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787892949.194684:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455530496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892949.194691:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1787892949.194827:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90712e5c0000 x1874741455530496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892965 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892949.194850:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e5c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455530496:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787892950.089324:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787892950.687171:0:10129:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 00:55:48 (1787892948) === 00000100:00100000:1.0:1787892951.112580:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787892951.115928:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431379072 00000100:00100000:2.0:1787892951.115944:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431379072 00000100:00100000:2.0:1787892951.116033:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 206 00000100:00100000:2.0:1787892951.116044:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+10:8132:x1874741431379072:12345-192.168.202.29@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787892951.116062:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787892951.116081:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9071102b8a00/0x825e3f5022b4a740 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821ae0d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892951.116110:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9071102b8a00/0x825e3f5022b4a740 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae0d expref: 11 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892951.116120:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9071102b8a00/0x825e3f5022b4a740 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae0d expref: 11 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892951.116129:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071102b8a00, rc 0) 00000100:00100000:2.0:1787892951.116217:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+11:8132:x1874741431379072:12345-192.168.202.29@tcp:101:mount.lustre.0 Request processed in 174us (3648us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892951.116238:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 206 00010000:00010000:3.0:1787892951.119077:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787892951.126468:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787892951.126585:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431379200 00000100:00100000:1.0:1787892951.126596:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431379200 00000100:00100000:1.0:1787892951.126651:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 207 00000100:00100000:1.0:1787892951.126660:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+11:8132:x1874741431379200:12345-192.168.202.29@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787892951.126999:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+11:8132:x1874741431379200:12345-192.168.202.29@tcp:501:mount.lustre.0 Request processed in 339us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892951.127017:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 207 00000100:00100000:1.0:1787892951.135457:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787892951.136477:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431379328 00000100:00100000:0.0:1787892951.136490:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431379328 00000100:00100000:0.0:1787892951.136583:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 208 00000100:00100000:0.0:1787892951.136594:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+11:8132:x1874741431379328:12345-192.168.202.29@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787892951.137464:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+11:8132:x1874741431379328:12345-192.168.202.29@tcp:503:mount.lustre.0 Request processed in 864us (2010us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892951.137475:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 208 00000100:00100000:0.0:1787892951.140854:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787892951.140955:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431379456 00000100:00100000:2.0:1787892951.140984:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431379456 00000100:00100000:2.0:1787892951.141047:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 209 00000100:00100000:2.0:1787892951.141057:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+11:8136:x1874741431379456:12345-192.168.202.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787892951.141607:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+11:8136:x1874741431379456:12345-192.168.202.29@tcp:502:llog_process_th.0 Request processed in 549us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892951.141615:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 209 00000100:00100000:2.0:1787892951.174495:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787892951.174953:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431379584 00000100:00100000:0.0:1787892951.175134:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431379584 00000100:00100000:0.0:1787892951.175324:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 210 00000100:00100000:0.0:1787892951.175347:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+11:8136:x1874741431379584:12345-192.168.202.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787892951.176187:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+11:8136:x1874741431379584:12345-192.168.202.29@tcp:502:llog_process_th.0 Request processed in 839us (1701us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892951.176205:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 210 00000100:00100000:3.0:1787892951.181623:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787892951.183948:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431379712 00000100:00100000:1.0:1787892951.184300:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431379712 00000100:00100000:1.0:1787892951.184664:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 211 00000100:00100000:1.0:1787892951.184676:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+11:8132:x1874741431379712:12345-192.168.202.29@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787892951.184701:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787892951.184721:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9071421faa00/0x825e3f5022b4a747 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821ae37 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892951.185313:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9071421faa00/0x825e3f5022b4a747 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae37 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892951.185326:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9071421faa00/0x825e3f5022b4a747 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae37 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892951.185449:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071421faa00, rc 0) 00000100:00100000:1.0:1787892951.185528:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+12:8132:x1874741431379712:12345-192.168.202.29@tcp:101:mount.lustre.0 Request processed in 854us (3916us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892951.185536:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 211 00000100:00100000:1.0:1787892951.193461:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787892951.194254:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431379840 00000100:00100000:0.0:1787892951.194270:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431379840 00000100:00100000:0.0:1787892951.194503:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 212 00000100:00100000:0.0:1787892951.194517:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+12:8132:x1874741431379840:12345-192.168.202.29@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787892951.194544:0:5841:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787892951.194570:0:5841:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787892951.194575:0:5841:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787892951.194578:0:5841:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787892951.194588:0:5841:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1787892951.198303:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+12:8132:x1874741431379840:12345-192.168.202.29@tcp:256:mount.lustre.0 Request processed in 3774us (4842us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892951.198321:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 212 00000100:00100000:3.0:1787892951.201682:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787892951.201835:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431379968 00000100:00100000:1.0:1787892951.201848:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431379968 00000100:00100000:1.0:1787892951.201905:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 213 00000100:00100000:1.0:1787892951.201925:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+12:8132:x1874741431379968:12345-192.168.202.29@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787892951.201945:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787892951.202270:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9071421fa600/0x825e3f5022b4a74e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821ae3e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892951.202307:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9071421fa600/0x825e3f5022b4a74e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae3e expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892951.202320:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9071421fa600/0x825e3f5022b4a74e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae3e expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892951.202450:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071421fa600, rc 0) 00000100:00100000:1.0:1787892951.202580:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+13:8132:x1874741431379968:12345-192.168.202.29@tcp:101:mount.lustre.0 Request processed in 663us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892951.202588:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 213 00000100:00100000:2.0:1787892951.207648:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787892951.207871:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431380096 00000100:00100000:0.0:1787892951.207881:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431380096 00000100:00100000:0.0:1787892951.207938:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 214 00000100:00100000:0.0:1787892951.207949:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+13:8132:x1874741431380096:12345-192.168.202.29@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787892951.210321:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+13:8132:x1874741431380096:12345-192.168.202.29@tcp:501:mount.lustre.0 Request processed in 2359us (2669us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892951.210354:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 214 00000100:00100000:0.0:1787892951.216535:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787892951.216652:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431380224 00000100:00100000:1.0:1787892951.216663:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431380224 00000100:00100000:1.0:1787892951.216908:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 215 00000100:00100000:1.0:1787892951.216919:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+13:8132:x1874741431380224:12345-192.168.202.29@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787892951.217185:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+13:8132:x1874741431380224:12345-192.168.202.29@tcp:503:mount.lustre.0 Request processed in 267us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892951.217201:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 215 00000100:00100000:3.0:1787892951.222995:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787892951.223153:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431380352 00000100:00100000:0.0:1787892951.223169:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431380352 00000100:00100000:0.0:1787892951.223233:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 216 00000100:00100000:0.0:1787892951.223244:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+13:8140:x1874741431380352:12345-192.168.202.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787892951.223527:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+13:8140:x1874741431380352:12345-192.168.202.29@tcp:502:llog_process_th.0 Request processed in 284us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892951.223535:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 216 00000100:00100000:2.0:1787892951.239799:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787892951.239886:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431380480 00000100:00100000:0.0:1787892951.239898:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431380480 00000100:00100000:0.0:1787892951.239977:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 217 00000100:00100000:0.0:1787892951.239991:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+13:8140:x1874741431380480:12345-192.168.202.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787892951.240312:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+13:8140:x1874741431380480:12345-192.168.202.29@tcp:502:llog_process_th.0 Request processed in 322us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892951.240320:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 217 00000100:00100000:3.0:1787892951.246312:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892951.246518:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787892951.247638:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431380608 00000100:00100000:2.0:1787892951.247654:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431380608 00000100:00100000:2.0:1787892951.247739:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431380992 00000100:00100000:2.0:1787892951.247743:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431380992 00000100:00080000:1.0:1787892951.247845:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787892951.248250:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 62 00000100:00100000:0.0:1787892951.248266:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137f7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+6:2362:x1874741431380992:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1787892951.248400:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137f7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+6:2362:x1874741431380992:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 140us (1881us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892951.248408:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 62 00000100:00100000:0.0:1787892951.248429:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 10 00000100:00100000:0.0:1787892951.248434:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137f7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2359:x1874741431380608:12345-192.168.202.29@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787892951.248460:0:8281:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from db96701a-d972-4021-b77b-4d58b82fa12c@192.168.202.29@tcp t0 exp 0000000000000000 cur 279 last 0 00000020:00000080:0.0:1787892951.248502:0:8281:0:(genops.c:1385:class_connect()) connect: client db96701a-d972-4021-b77b-4d58b82fa12c, cookie 0x825e3f5022b4a755 00000004:00100000:0.0:1787892951.248541:0:8281:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787892951.249347:0:8281:0:(import.c:65:import_set_state_nolock()) ffff90713f9c1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787892951.249400:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137f7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db96701a-d972-4021-b77b-4d58b82fa12c+6:2359:x1874741431380608:12345-192.168.202.29@tcp:38:mount.lustre.0 Request processed in 964us (3137us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892951.249410:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 10 00000100:00100000:3.0:1787892951.265907:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892951.265961:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787892951.266007:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431380864 00000100:00100000:0.0:1787892951.266030:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431380864 00000100:00100000:0.0:1787892951.266120:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 11 00000100:00100000:0.0:1787892951.266131:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137f7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db96701a-d972-4021-b77b-4d58b82fa12c+6:8132:x1874741431380864:12345-192.168.202.29@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787892951.266206:0:5849:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787892951.266238:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431380736 00000100:00100000:3.0:1787892951.266244:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431380736 00000100:00100000:3.0:1787892951.266278:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 12 00000100:00100000:3.0:1787892951.266287:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137f7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db96701a-d972-4021-b77b-4d58b82fa12c+7:0:x1874741431380736:12345-192.168.202.29@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787892951.266302:0:5847:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787892951.266307:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137f7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db96701a-d972-4021-b77b-4d58b82fa12c+7:8132:x1874741431380864:12345-192.168.202.29@tcp:41:mount.lustre.0 Request processed in 176us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892951.266317:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 11 00000100:00100000:3.0:1787892951.266338:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137f7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db96701a-d972-4021-b77b-4d58b82fa12c+7:0:x1874741431380736:12345-192.168.202.29@tcp:41:mount.lustre.0 Request processed in 51us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892951.266345:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 12 00000100:00080000:1.0:1787892951.266428:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787892951.269046:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892951.269494:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431381120 00000100:00100000:3.0:1787892951.269509:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431381120 00000100:00100000:3.0:1787892951.269659:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 13 00000100:00100000:3.0:1787892951.269675:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db96701a-d972-4021-b77b-4d58b82fa12c+6:8132:x1874741431381120:12345-192.168.202.29@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787892951.271216:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db96701a-d972-4021-b77b-4d58b82fa12c+6:8132:x1874741431381120:12345-192.168.202.29@tcp:40:mount.lustre.0 Request processed in 1523us (2166us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892951.271935:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 13 00000100:00100000:2.0:1787892951.277897:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787892951.277943:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787892951.277990:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787892951.278100:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431381504 00000100:00100000:0.0:1787892951.278119:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431381504 00000100:00100000:0.0:1787892951.278213:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1 00000100:00100000:0.0:1787892951.278240:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db96701a-d972-4021-b77b-4d58b82fa12c+6:8132:x1874741431381504:12345-192.168.202.29@tcp:33:mount.lustre.0 00000004:00200000:0.0:1787892951.281266:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787892951.281305:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431381248 00000100:00100000:3.0:1787892951.281326:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431381248 00000100:00100000:3.0:1787892951.281398:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431381376 00000100:00100000:3.0:1787892951.281403:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431381376 00000100:00100000:3.0:1787892951.281444:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 12 00000100:00100000:3.0:1787892951.281476:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2359:x1874741431381248:12345-192.168.202.29@tcp:8:mount.lustre.0 00000100:00100000:1.0:1787892951.281484:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 13 00000100:00100000:1.0:1787892951.281503:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2359:x1874741431381376:12345-192.168.202.29@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787892951.281531:0:8105:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from db96701a-d972-4021-b77b-4d58b82fa12c@192.168.202.29@tcp t0 exp 0000000000000000 cur 279 last 0 00010000:00080000:1.0:1787892951.281548:0:6701:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from db96701a-d972-4021-b77b-4d58b82fa12c@192.168.202.29@tcp t0 exp 0000000000000000 cur 279 last 0 00000020:00000080:3.0:1787892951.281618:0:8105:0:(genops.c:1385:class_connect()) connect: client db96701a-d972-4021-b77b-4d58b82fa12c, cookie 0x825e3f5022b4a763 00000020:00000080:1.0:1787892951.281621:0:6701:0:(genops.c:1385:class_connect()) connect: client db96701a-d972-4021-b77b-4d58b82fa12c, cookie 0x825e3f5022b4a75c 00002000:00100000:3.0:1787892951.281643:0:8105:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli db96701a-d972-4021-b77b-4d58b82fa12c/ffff90712c5fd000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787892951.281696:0:8105:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1787892951.282097:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db96701a-d972-4021-b77b-4d58b82fa12c+6:8132:x1874741431381504:12345-192.168.202.29@tcp:33:mount.lustre.0 Request processed in 3852us (4210us total) trans 0 rc 0/0 00002000:00080000:3.0:1787892951.282100:0:8105:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:0.0:1787892951.282114:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1 00000100:00080000:3.0:1787892951.282156:0:8105:0:(import.c:65:import_set_state_nolock()) ffff90712c5f9800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787892951.282235:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db96701a-d972-4021-b77b-4d58b82fa12c+6:2359:x1874741431381248:12345-192.168.202.29@tcp:8:mount.lustre.0 Request processed in 763us (4289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892951.282244:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 12 00002000:00100000:0.0:1787892951.287686:0:6701:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli db96701a-d972-4021-b77b-4d58b82fa12c/ffff9071075bc000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787892951.287733:0:6701:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787892951.288080:0:6701:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787892951.288132:0:6701:0:(import.c:65:import_set_state_nolock()) ffff90713f9c7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787892951.288234:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:db96701a-d972-4021-b77b-4d58b82fa12c+6:2359:x1874741431381376:12345-192.168.202.29@tcp:8:mount.lustre.0 Request processed in 6731us (10240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892951.288246:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 13 00010000:00010000:2.0:1787892952.136926:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787892952.369074:0:5870:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of db96701a-d972-4021-b77b-4d58b82fa12c 00000100:00100000:0.0:1787892952.779955:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787892952.779981:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f4bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455530624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787892952.780056:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892952.780127:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455530624 00000100:00100000:0.0:1787892952.780135:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455530624 00000100:00100000:0.0:1787892952.780204:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787892952.780215:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455530624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787892952.780243:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787892952.780293:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455530624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892952.780301:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1787892952.780322:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787892952.780353:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90713f4bc700 x1874741455530624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892968 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892952.780392:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f4bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455530624:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1787892952.870743:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of db96701a-d972-4021-b77b-4d58b82fa12c 00010000:00010000:3.0:1787892953.163900:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787892953.809662:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137f7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874741455531008:0@lo:400:kworker.0 00000100:00100000:0.0:1787892953.809738:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892953.809819:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787892953.809825:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137f7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455531136:0@lo:400:kworker.0 00000100:00100000:0.0:1787892953.809851:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892953.809884:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455531008 00000100:00100000:0.0:1787892953.809891:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455531008 00000100:00100000:0.0:1787892953.809951:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787892953.809962:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874741455531008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787892953.810012:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874741455531008:12345-0@lo:400:kworker.0 Request processed in 53us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892953.810020:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787892953.810042:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455531136 00000100:00100000:0.0:1787892953.810046:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455531136 00000100:00100000:2.0:1787892953.810807:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137f7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455530752:0@lo:400:kworker.0 00000100:00100000:2.0:1787892953.810862:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892953.810894:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137f7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874741455531264:0@lo:400:kworker.0 00000100:00100000:2.0:1787892953.810917:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892953.810938:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787892953.810945:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137f7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874741455530880:0@lo:400:kworker.0 00000100:00100000:2.0:1787892953.810984:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892953.811004:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137f7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455531392:0@lo:400:kworker.0 00000100:00100000:2.0:1787892953.811027:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892953.811232:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455531264 00000100:00100000:2.0:1787892953.811238:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455531264 00000100:00100000:2.0:1787892953.811276:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455530880 00000100:00100000:2.0:1787892953.811279:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455530880 00000100:00100000:2.0:1787892953.811291:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787892953.811299:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874741455531264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787892953.811341:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874741455531264:12345-0@lo:400:kworker.0 Request processed in 43us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892953.811348:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787892953.811365:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787892953.811371:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f564380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874741455530880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787892953.811396:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f564380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874741455530880:12345-0@lo:400:kworker.0 Request processed in 25us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892953.811401:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787892953.815766:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455531392 00000100:00100000:0.0:1787892953.815782:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455531392 00000100:00100000:0.0:1787892953.815818:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787892953.815830:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455531136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787892953.815929:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455531136:12345-0@lo:400:kworker.0 Request processed in 102us (6076us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892953.815936:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787892953.815953:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787892953.815959:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f566300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455531392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787892953.815989:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f566300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455531392:12345-0@lo:400:kworker.0 Request processed in 30us (4961us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892953.816010:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1787892953.816042:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787892953.816048:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787892953.816109:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff907137f7ea00 x1874741455531136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892953.816127:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137f7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455531136:0@lo:400:kworker.0 00000100:00100000:0.0:1787892953.816142:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137f7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874741455531008:0@lo:400:kworker.0 00000100:00100000:1.0:1787892953.816687:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455530752 00000100:00100000:1.0:1787892953.816694:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455530752 00000100:00100000:1.0:1787892953.816727:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1787892953.816734:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+19:3305:x1874741455530752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787892953.816805:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+19:3305:x1874741455530752:12345-0@lo:400:kworker.0 Request processed in 71us (5942us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892953.816812:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1787892953.817101:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137f7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874741455530880:0@lo:400:kworker.0 00010000:00080000:2.0:1787892953.817124:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff907137f7d880 x1874741455531392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892953.817149:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137f7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455531392:0@lo:400:kworker.0 00000100:00100000:2.0:1787892953.817160:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137f7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455530752:0@lo:400:kworker.0 00000100:00100000:2.0:1787892953.817186:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137f7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874741455531264:0@lo:400:kworker.0 00000001:00100000:1.0:1787892953.876649:0:6725:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of db96701a-d972-4021-b77b-4d58b82fa12c 00010000:00010000:3.0:1787892954.185193:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787892954.318331:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787892954.318358:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e5c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455531520:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787892954.318435:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892954.318507:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455531520 00000100:00100000:1.0:1787892954.318517:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455531520 00000100:00100000:1.0:1787892954.318582:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787892954.318591:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e5c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455531520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787892954.318632:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787892954.318681:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e5c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455531520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892954.318688:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1787892954.318737:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90712e5c3480 x1874741455531520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892970 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892954.318777:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e5c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455531520:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787892955.208970:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787892956.233096:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787892956.725231:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787892956.725273:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787892956.725303:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787892956.725324:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787892956.725345:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787892956.725371:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431382144 00000100:00100000:0.0:1787892956.725380:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431382144 00000100:00100000:0.0:1787892956.725432:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431382016 00000100:00100000:0.0:1787892956.725435:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431382016 00000100:00100000:0.0:1787892956.725472:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 36 00000100:00100000:0.0:1787892956.725594:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db96701a-d972-4021-b77b-4d58b82fa12c+5:2361:x1874741431382144:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1787892956.725672:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db96701a-d972-4021-b77b-4d58b82fa12c+5:2361:x1874741431382144:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 83us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892956.725681:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 36 00000100:00100000:0.0:1787892956.725698:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 37 00000100:00100000:0.0:1787892956.725705:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db96701a-d972-4021-b77b-4d58b82fa12c+5:2361:x1874741431382016:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1787892956.725731:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db96701a-d972-4021-b77b-4d58b82fa12c+5:2361:x1874741431382016:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 26us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892956.725780:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 37 00000100:00100000:0.0:1787892956.725799:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431381888 00000100:00100000:0.0:1787892956.725802:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431381888 00000100:00100000:0.0:1787892956.725827:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431381760 00000100:00100000:0.0:1787892956.725830:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431381760 00000100:00100000:0.0:1787892956.725849:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 66 00000100:00100000:0.0:1787892956.725855:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db96701a-d972-4021-b77b-4d58b82fa12c+5:2361:x1874741431381888:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1787892956.725885:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db96701a-d972-4021-b77b-4d58b82fa12c+5:2361:x1874741431381888:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 30us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892956.725891:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 66 00000100:00100000:0.0:1787892956.725902:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 67 00000100:00100000:0.0:1787892956.725908:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+6:2361:x1874741431381760:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1787892956.725928:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+6:2361:x1874741431381760:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 21us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892956.725933:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 67 00000100:00080000:0.0:1787892956.725950:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787892956.725954:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787892956.725956:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787892956.726131:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431381632 00000100:00100000:3.0:1787892956.726136:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431381632 00000100:00100000:3.0:1787892956.726180:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 219 00000100:00100000:3.0:1787892956.726187:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+13:2361:x1874741431381632:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1787892956.726270:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+13:2361:x1874741431381632:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 82us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892956.726276:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 219 00000001:02000400:0.0:1787892957.029274:0:10326:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg229-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1787892957.257223:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787892957.897103:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787892957.897128:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f567800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455531648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787892957.897209:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892957.897276:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455531648 00000100:00100000:2.0:1787892957.897285:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455531648 00000100:00100000:2.0:1787892957.897348:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787892957.897358:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f565c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455531648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787892957.897404:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787892957.897455:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f565c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455531648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892957.897462:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1787892957.897485:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787892957.897513:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90713f567800 x1874741455531648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892973 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892957.897534:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f567800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455531648:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787892958.282838:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787892958.922573:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f564700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455532160:0@lo:400:kworker.0 00000100:00100000:2.0:1787892958.922653:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892958.922723:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787892958.922730:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f564a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874741455532032:0@lo:400:kworker.0 00000100:00100000:2.0:1787892958.922804:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892958.923168:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f565f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874741455531904:0@lo:400:kworker.0 00000100:00100000:3.0:1787892958.923203:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892958.923241:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f567100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455532416:0@lo:400:kworker.0 00000100:00100000:3.0:1787892958.923264:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892958.923296:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787892958.923302:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f567800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22d910cf-711e-44e0-9acf-212404ada550:3306:1874741455531776:0@lo:400:kworker.0 00000100:00100000:3.0:1787892958.923329:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892958.923347:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f566d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874741455532288:0@lo:400:kworker.0 00000100:00100000:3.0:1787892958.923368:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892958.923544:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455531776 00000100:00100000:1.0:1787892958.923553:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455531776 00000100:00100000:1.0:1787892958.923610:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1787892958.923620:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+19:3306:x1874741455531776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787892958.923691:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+19:3306:x1874741455531776:12345-0@lo:400:kworker.0 Request processed in 72us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892958.923711:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1787892958.923788:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f567800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22d910cf-711e-44e0-9acf-212404ada550:3306:1874741455531776:0@lo:400:kworker.0 00000100:00100000:2.0:1787892958.924078:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455532032 00000100:00100000:2.0:1787892958.924093:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455532032 00000100:00100000:2.0:1787892958.924153:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455531904 00000100:00100000:2.0:1787892958.924157:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455531904 00000100:00100000:2.0:1787892958.924167:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455532288 00000100:00100000:2.0:1787892958.924170:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455532288 00000100:00100000:2.0:1787892958.924184:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787892958.924190:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f567480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874741455532032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787892958.924251:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f567480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874741455532032:12345-0@lo:400:kworker.0 Request processed in 60us (1445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892958.924258:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787892958.924273:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787892958.924279:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137f7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874741455531904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787892958.924310:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137f7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874741455531904:12345-0@lo:400:kworker.0 Request processed in 32us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892958.924378:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787892958.924393:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787892958.924400:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137f7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874741455532288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787892958.924429:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137f7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874741455532288:12345-0@lo:400:kworker.0 Request processed in 30us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892958.924434:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787892958.924470:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f564a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874741455532032:0@lo:400:kworker.0 00000100:00100000:0.0:1787892958.924526:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455532160 00000100:00100000:0.0:1787892958.924531:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455532160 00000100:00100000:0.0:1787892958.924565:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455532416 00000100:00100000:0.0:1787892958.924568:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455532416 00000100:00100000:0.0:1787892958.924589:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787892958.924596:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f564000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455532160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787892958.924629:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f564000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455532160:12345-0@lo:400:kworker.0 Request processed in 34us (1977us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892958.924644:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787892958.924663:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787892958.924669:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137f7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455532416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787892958.924709:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137f7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455532416:12345-0@lo:400:kworker.0 Request processed in 41us (1444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892958.924715:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1787892958.924886:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90713f564700 x1874741455532160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892958.925011:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f564700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455532160:0@lo:400:kworker.0 00000100:00100000:2.0:1787892958.925207:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f566d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874741455532288:0@lo:400:kworker.0 00000100:00100000:2.0:1787892958.925293:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f565f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874741455531904:0@lo:400:kworker.0 00010000:00080000:2.0:1787892958.925304:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90713f567100 x1874741455532416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892958.925313:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f567100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455532416:0@lo:400:kworker.0 00000100:00080000:1.0:1787892958.925359:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787892958.925364:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787892959.306875:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787892959.437837:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787892959.437864:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f4be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455532544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787892959.437998:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892959.438094:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455532544 00000100:00100000:1.0:1787892959.438104:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455532544 00000100:00100000:1.0:1787892959.438168:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787892959.438182:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455532544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787892959.438389:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787892959.438435:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455532544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 254us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892959.438442:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1787892959.438742:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90713f4be680 x1874741455532544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892975 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892959.438782:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f4be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455532544:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787892960.329410:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892961.354944:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787892961.854884:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892961.854930:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892961.854960:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892961.855052:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892961.855189:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787892961.855242:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431382272 00000100:00100000:0.0:1787892961.855253:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431382272 00000100:00100000:0.0:1787892961.855311:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 221 00000100:00100000:0.0:1787892961.855321:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+13:2362:x1874741431382272:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1787892961.855390:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+13:2362:x1874741431382272:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 71us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892961.855397:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 221 00000100:00100000:2.0:1787892961.857156:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431382528 00000100:00100000:2.0:1787892961.857170:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431382528 00000100:00100000:2.0:1787892961.857243:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431382400 00000100:00100000:2.0:1787892961.857246:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431382400 00000100:00100000:2.0:1787892961.857276:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 71 00000100:00100000:2.0:1787892961.857285:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137f7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db96701a-d972-4021-b77b-4d58b82fa12c+5:2362:x1874741431382528:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1787892961.857344:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137f7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db96701a-d972-4021-b77b-4d58b82fa12c+5:2362:x1874741431382528:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 60us (2413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892961.857350:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 71 00000100:00100000:2.0:1787892961.857367:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 72 00000100:00100000:2.0:1787892961.857374:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137f7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+6:2362:x1874741431382400:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1787892961.857395:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137f7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+6:2362:x1874741431382400:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 22us (2343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892961.857402:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 72 00000100:00080000:0.0:1787892961.860158:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787892961.865675:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431382784 00000100:00100000:1.0:1787892961.865693:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431382784 00000100:00100000:1.0:1787892961.865800:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431382656 00000100:00100000:1.0:1787892961.865804:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431382656 00000100:00100000:1.0:1787892961.865837:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 40 00000100:00100000:1.0:1787892961.865850:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137f7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db96701a-d972-4021-b77b-4d58b82fa12c+5:2362:x1874741431382784:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1787892961.865934:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137f7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db96701a-d972-4021-b77b-4d58b82fa12c+5:2362:x1874741431382784:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 86us (10971us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892961.865942:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 40 00000100:00100000:1.0:1787892961.865959:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 41 00000100:00100000:1.0:1787892961.865965:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137f7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db96701a-d972-4021-b77b-4d58b82fa12c+5:2362:x1874741431382656:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1787892961.868022:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137f7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db96701a-d972-4021-b77b-4d58b82fa12c+5:2362:x1874741431382656:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 2044us (12819us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892961.868037:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 41 00000100:00080000:2.0:1787892961.868595:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787892961.868603:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787892962.381362:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787892963.019519:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787892963.020935:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137f7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455532672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787892963.021056:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892963.021326:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455532672 00000100:00100000:2.0:1787892963.021342:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455532672 00000100:00100000:2.0:1787892963.021431:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787892963.021466:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137f7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455532672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787892963.021528:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787892963.021623:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137f7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455532672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 163us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892963.021632:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1787892963.021670:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787892963.021715:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff907137f7fb80 x1874741455532672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892979 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892963.021744:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137f7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455532672:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787892963.401030:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787892964.048204:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e5c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455532800:0@lo:400:kworker.0 00000100:00100000:0.0:1787892964.048322:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892964.048439:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455532800 00000100:00100000:2.0:1787892964.048451:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455532800 00000100:00100000:2.0:1787892964.048527:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1787892964.048539:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+19:3305:x1874741455532800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787892964.048707:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+19:3305:x1874741455532800:12345-0@lo:400:kworker.0 Request processed in 168us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892964.048717:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1787892964.048843:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e5c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874741455532928:0@lo:400:kworker.0 00000100:00100000:2.0:1787892964.048880:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892964.048921:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455532928 00000100:00100000:2.0:1787892964.048925:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455532928 00000100:00100000:2.0:1787892964.048962:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787892964.048971:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f567100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874741455532928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787892964.049014:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f567100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874741455532928:12345-0@lo:400:kworker.0 Request processed in 45us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892964.049021:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787892964.049070:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e5c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874741455532928:0@lo:400:kworker.0 00000100:00100000:0.0:1787892964.052694:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e5c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455532800:0@lo:400:kworker.0 00000100:00100000:1.0:1787892964.053022:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e5c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874741455533056:0@lo:400:kworker.0 00000100:00100000:0.0:1787892964.053141:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e5c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874741455533312:0@lo:400:kworker.0 00000100:00100000:0.0:1787892964.053227:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892964.053266:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787892964.053272:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e5c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455533440:0@lo:400:kworker.0 00000100:00100000:0.0:1787892964.053304:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892964.053340:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455533440 00000100:00100000:0.0:1787892964.053349:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455533440 00000100:00100000:0.0:1787892964.053415:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787892964.053425:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907110cf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455533440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787892964.053483:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907110cf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455533440:12345-0@lo:400:kworker.0 Request processed in 59us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892964.053491:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1787892964.053693:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90712e5c1880 x1874741455533440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892964.053709:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e5c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455533440:0@lo:400:kworker.0 00000100:00100000:2.0:1787892964.054388:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e5c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455533184:0@lo:400:kworker.0 00000100:00100000:2.0:1787892964.054439:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892964.054499:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455533312 00000100:00100000:2.0:1787892964.054505:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455533312 00000100:00100000:2.0:1787892964.054550:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787892964.054560:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874741455533312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787892964.054611:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874741455533312:12345-0@lo:400:kworker.0 Request processed in 54us (1386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892964.054619:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1787892964.054641:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787892964.054646:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787892964.054657:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455533184 00000100:00100000:2.0:1787892964.054660:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455533184 00000100:00100000:2.0:1787892964.054687:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787892964.054694:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f565f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455533184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787892964.054733:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f565f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455533184:12345-0@lo:400:kworker.0 Request processed in 39us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892964.054739:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1787892964.054802:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90712e5c2a00 x1874741455533184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892964.054815:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e5c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455533184:0@lo:400:kworker.0 00000100:00100000:1.0:1787892964.054967:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892964.055006:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455533056 00000100:00100000:1.0:1787892964.055010:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455533056 00000100:00100000:1.0:1787892964.055056:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787892964.055064:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e5c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874741455533056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787892964.055113:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e5c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874741455533056:12345-0@lo:400:kworker.0 Request processed in 50us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892964.055120:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1787892964.055138:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787892964.056367:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e5c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874741455533056:0@lo:400:kworker.0 00000100:00100000:2.0:1787892964.062205:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e5c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874741455533312:0@lo:400:kworker.0 00010000:00010000:2.0:1787892964.424931:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787892964.552929:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787892964.552955:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f4bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455533568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787892964.553037:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892964.553118:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455533568 00000100:00100000:0.0:1787892964.553126:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455533568 00000100:00100000:0.0:1787892964.553187:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787892964.553199:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455533568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787892964.553240:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787892964.553292:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455533568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892964.553301:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1787892964.553342:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90713f4bca80 x1874741455533568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892980 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892964.553382:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f4bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455533568:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787892965.449592:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787892966.474436:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787892966.964240:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787892966.964279:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787892966.964308:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787892966.964326:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787892966.964353:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787892966.964381:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431383168 00000100:00100000:2.0:1787892966.964397:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431383168 00000100:00100000:2.0:1787892966.964453:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431383040 00000100:00100000:2.0:1787892966.964456:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431383040 00000100:00100000:2.0:1787892966.964476:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 76 00000100:00100000:2.0:1787892966.964485:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f566d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db96701a-d972-4021-b77b-4d58b82fa12c+5:2360:x1874741431383168:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1787892966.964560:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f566d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db96701a-d972-4021-b77b-4d58b82fa12c+5:2360:x1874741431383168:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 76us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892966.964567:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 76 00000100:00100000:2.0:1787892966.964584:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 77 00000100:00100000:2.0:1787892966.964589:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f564a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+6:2360:x1874741431383040:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1787892966.964610:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f564a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+6:2360:x1874741431383040:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 21us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892966.964615:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 77 00000100:00100000:2.0:1787892966.964629:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431383424 00000100:00100000:2.0:1787892966.964632:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431383424 00000100:00100000:2.0:1787892966.964653:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431383296 00000100:00100000:2.0:1787892966.964655:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431383296 00000100:00100000:2.0:1787892966.964673:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 44 00000100:00100000:2.0:1787892966.964678:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f564700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db96701a-d972-4021-b77b-4d58b82fa12c+5:2360:x1874741431383424:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1787892966.964699:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f564700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db96701a-d972-4021-b77b-4d58b82fa12c+5:2360:x1874741431383424:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 21us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892966.964705:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 44 00000100:00100000:2.0:1787892966.964714:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 45 00000100:00100000:2.0:1787892966.964719:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f567b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db96701a-d972-4021-b77b-4d58b82fa12c+5:2360:x1874741431383296:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1787892966.964737:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f567b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db96701a-d972-4021-b77b-4d58b82fa12c+5:2360:x1874741431383296:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 19us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892966.964748:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 45 00000100:00080000:2.0:1787892966.964788:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787892966.964792:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787892966.964794:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787892966.964984:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431382912 00000100:00100000:0.0:1787892966.964989:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431382912 00000100:00100000:0.0:1787892966.965027:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 223 00000100:00100000:0.0:1787892966.965034:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+13:2360:x1874741431382912:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1787892966.965088:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+13:2360:x1874741431382912:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 44us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892966.965095:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 223 00010000:00010000:2.0:1787892967.496924:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787892968.137594:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787892968.137625:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137f7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455533696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787892968.137714:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892968.138831:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455533696 00000100:00100000:3.0:1787892968.138851:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455533696 00000100:00100000:3.0:1787892968.138927:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787892968.138938:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f564e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455533696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787892968.138990:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787892968.139064:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f564e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455533696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (1350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892968.139071:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1787892968.139548:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff907137f7fb80 x1874741455533696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892984 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892968.139571:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137f7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455533696:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787892968.140200:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787892968.521182:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787892969.162230:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f566680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455533824:0@lo:400:kworker.0 00000100:00100000:2.0:1787892969.162314:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892969.162361:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f565500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874741455534336:0@lo:400:kworker.0 00000100:00100000:2.0:1787892969.162389:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892969.162415:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787892969.162420:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f566a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874741455533952:0@lo:400:kworker.0 00000100:00100000:2.0:1787892969.162441:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892969.162455:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f566300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455534464:0@lo:400:kworker.0 00000100:00100000:2.0:1787892969.162503:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892969.162540:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455533824 00000100:00100000:2.0:1787892969.162548:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455533824 00000100:00100000:2.0:1787892969.162609:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1787892969.162618:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+19:3305:x1874741455533824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787892969.162673:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+19:3305:x1874741455533824:12345-0@lo:400:kworker.0 Request processed in 56us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892969.162681:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1787892969.162694:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f565880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455534208:0@lo:400:kworker.0 00000100:00100000:2.0:1787892969.162714:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455534336 00000100:00100000:2.0:1787892969.162718:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455534336 00000100:00100000:0.0:1787892969.162721:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892969.162741:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787892969.162747:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f565180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874741455534080:0@lo:400:kworker.0 00000100:00100000:2.0:1787892969.162778:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455533952 00000100:00100000:2.0:1787892969.162781:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455533952 00000100:00100000:0.0:1787892969.162785:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892969.162795:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455534080 00000100:00100000:2.0:1787892969.162798:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455534080 00000100:00100000:2.0:1787892969.162813:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787892969.162819:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874741455534336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787892969.162824:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455534464 00000100:00100000:0.0:1787892969.162826:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455534464 00000100:00100000:2.0:1787892969.162851:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874741455534336:12345-0@lo:400:kworker.0 Request processed in 32us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892969.162852:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455534208 00000100:00100000:0.0:1787892969.162855:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455534208 00000100:00100000:2.0:1787892969.162857:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787892969.162869:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787892969.162871:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787892969.162874:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f567800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874741455533952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787892969.162876:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455534464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787892969.162899:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f567800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874741455533952:12345-0@lo:400:kworker.0 Request processed in 25us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892969.162899:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455534464:12345-0@lo:400:kworker.0 Request processed in 23us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892969.162906:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787892969.162906:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787892969.162917:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787892969.162917:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787892969.162923:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455534208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787892969.162924:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874741455534080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787892969.162950:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874741455534080:12345-0@lo:400:kworker.0 Request processed in 27us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892969.162956:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787892969.163083:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f566a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874741455533952:0@lo:400:kworker.0 00010000:00080000:2.0:1787892969.163099:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90713f566300 x1874741455534464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892969.163109:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f566300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455534464:0@lo:400:kworker.0 00000100:00100000:2.0:1787892969.163117:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f566680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455533824:0@lo:400:kworker.0 00000100:00100000:2.0:1787892969.163126:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f565500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874741455534336:0@lo:400:kworker.0 00000100:00080000:1.0:1787892969.163178:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787892969.163183:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787892969.167232:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455534208:12345-0@lo:400:kworker.0 Request processed in 4296us (4497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892969.167273:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787892969.172297:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f565180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874741455534080:0@lo:400:kworker.0 00010000:00080000:1.0:1787892969.172329:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90713f565880 x1874741455534208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892969.172340:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f565880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455534208:0@lo:400:kworker.0 00010000:00010000:1.0:1787892969.544998:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787892969.685570:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137f7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455534592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787892969.685647:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892969.685859:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455534592 00000100:00100000:3.0:1787892969.685867:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455534592 00000100:00100000:3.0:1787892969.685927:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787892969.685939:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455534592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787892969.685980:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787892969.686042:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455534592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892969.686050:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1787892969.686091:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff907137f7fb80 x1874741455534592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892985 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892969.686110:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137f7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455534592:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787892970.568963:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892971.601597:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787892972.092123:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892972.092375:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431383680 00000100:00100000:3.0:1787892972.092386:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431383680 00000100:00100000:3.0:1787892972.092460:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 81 00000100:00100000:3.0:1787892972.092471:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+6:2360:x1874741431383680:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1787892972.092551:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+6:2360:x1874741431383680:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 82us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892972.092560:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 81 00000100:00080000:0.0:1787892972.092653:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787892972.099217:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787892972.099261:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787892972.099296:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431383936 00000100:00100000:2.0:1787892972.099306:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431383936 00000100:00100000:2.0:1787892972.099363:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431384064 00000100:00100000:2.0:1787892972.099366:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431384064 00000100:00100000:2.0:1787892972.099392:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 14 00000100:00100000:2.0:1787892972.099402:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db96701a-d972-4021-b77b-4d58b82fa12c+5:2359:x1874741431383936:12345-192.168.202.29@tcp:9:kworker.0 00000020:00000080:2.0:1787892972.099432:0:8105:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x825e3f5022b4a763 00000100:00080000:2.0:1787892972.099440:0:8105:0:(import.c:65:import_set_state_nolock()) ffff90712c5f9800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787892972.099480:0:8105:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787892972.100834:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 15 00000100:00100000:3.0:1787892972.100853:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db96701a-d972-4021-b77b-4d58b82fa12c+5:2359:x1874741431384064:12345-192.168.202.29@tcp:9:kworker.0 00000020:00000080:3.0:1787892972.100882:0:6700:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x825e3f5022b4a75c 00000100:00080000:3.0:1787892972.100905:0:6700:0:(import.c:65:import_set_state_nolock()) ffff90713f9c7800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787892972.100993:0:6700:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787892972.101403:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db96701a-d972-4021-b77b-4d58b82fa12c+2:2359:x1874741431384064:12345-192.168.202.29@tcp:9:kworker.0 Request processed in 555us (2139us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892972.101412:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 15 00010000:00010000:3.0:1787892972.101443:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787892972.101493:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892972.101602:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892972.101627:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431383552 00000100:00100000:3.0:1787892972.101634:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431383552 00000100:00100000:3.0:1787892972.101668:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 225 00000100:00100000:3.0:1787892972.101675:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+13:2361:x1874741431383552:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1787892972.101710:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+13:2361:x1874741431383552:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 35us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892972.101717:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 225 00000100:00100000:3.0:1787892972.101744:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431383808 00000100:00100000:3.0:1787892972.101748:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431383808 00000100:00100000:3.0:1787892972.101818:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 82 00000100:00100000:3.0:1787892972.101825:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137f7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db96701a-d972-4021-b77b-4d58b82fa12c+5:2361:x1874741431383808:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1787892972.101853:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137f7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db96701a-d972-4021-b77b-4d58b82fa12c+5:2361:x1874741431383808:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 29us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892972.101860:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 82 00000100:00100000:2.0:1787892972.105932:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db96701a-d972-4021-b77b-4d58b82fa12c+2:2359:x1874741431383936:12345-192.168.202.29@tcp:9:kworker.0 Request processed in 6517us (6714us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892972.105948:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 14 00000100:00080000:2.0:1787892972.107736:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787892972.107746:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787892972.107765:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787892972.107782:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892972.616990:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787892973.262229:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e5c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455534720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787892973.262315:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892973.262356:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455534720 00000100:00100000:3.0:1787892973.262366:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455534720 00000100:00080000:3.0:1787892973.262453:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787892973.262502:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787892973.262514:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e5c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455534720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787892973.262560:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787892973.262624:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e5c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455534720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892973.262633:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1787892973.262812:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90712e5c2680 x1874741455534720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892989 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892973.262859:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e5c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455534720:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1787892973.347174:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of db96701a-d972-4021-b77b-4d58b82fa12c 00000020:00000080:2.0:1787892973.347185:0:7656:0:(genops.c:885:class_export_put()) final put ffff9071075bc000/db96701a-d972-4021-b77b-4d58b82fa12c 00000020:00000080:0.0:1787892973.347218:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9071075bc000/db96701a-d972-4021-b77b-4d58b82fa12c for lustre-OST0001 00000020:00000080:0.0:1787892973.348778:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90713f9c7800 for lustre-OST0001 00010000:00010000:3.0:1787892973.642204:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787892974.062302:0:11027:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1787892974.285535:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137f7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874741455535104:0@lo:400:kworker.0 00000100:00100000:3.0:1787892974.285617:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892974.285675:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787892974.285682:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137f7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455535232:0@lo:400:kworker.0 00000100:00100000:3.0:1787892974.285711:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892974.285749:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455535104 00000100:00100000:3.0:1787892974.285779:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455535104 00000100:00100000:3.0:1787892974.285860:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787892974.285871:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137f7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874741455535104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787892974.285935:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137f7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874741455535104:12345-0@lo:400:kworker.0 Request processed in 66us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892974.285942:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787892974.285992:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455535232 00000100:00100000:3.0:1787892974.285996:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455535232 00000100:00100000:3.0:1787892974.286026:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787892974.286033:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907003899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455535232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787892974.286066:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907003899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455535232:12345-0@lo:400:kworker.0 Request processed in 33us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892974.286072:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1787892974.286090:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787892974.286129:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff907137f7ca80 x1874741455535232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892974.286146:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137f7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455535232:0@lo:400:kworker.0 00000100:00100000:3.0:1787892974.286174:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137f7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874741455535104:0@lo:400:kworker.0 00000100:00100000:2.0:1787892974.286435:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137f7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455534848:0@lo:400:kworker.0 00000100:00100000:2.0:1787892974.286478:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892974.286511:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137f7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874741455535360:0@lo:400:kworker.0 00000100:00100000:2.0:1787892974.286535:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892974.286557:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787892974.286572:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137f7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874741455534976:0@lo:400:kworker.0 00000100:00100000:2.0:1787892974.286598:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892974.286616:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137f7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455535488:0@lo:400:kworker.0 00000100:00100000:2.0:1787892974.286640:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892974.286673:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455534848 00000100:00100000:2.0:1787892974.286678:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455534848 00000100:00100000:2.0:1787892974.286709:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1787892974.286716:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+19:3305:x1874741455534848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787892974.286773:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+19:3305:x1874741455534848:12345-0@lo:400:kworker.0 Request processed in 58us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892974.286780:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1787892974.286809:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455535488 00000100:00100000:2.0:1787892974.286878:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455535488 00000100:00100000:2.0:1787892974.286910:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787892974.286917:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455535488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787892974.287033:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455535488:12345-0@lo:400:kworker.0 Request processed in 115us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892974.287040:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1787892974.287073:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff907137f7dc00 x1874741455535488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892990 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892974.287085:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137f7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455535488:0@lo:400:kworker.0 00000100:00100000:2.0:1787892974.287092:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137f7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455534848:0@lo:400:kworker.0 00000100:00100000:3.0:1787892974.287187:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455535360 00000100:00100000:3.0:1787892974.287193:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455535360 00000100:00100000:3.0:1787892974.287229:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455534976 00000100:00100000:3.0:1787892974.287232:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455534976 00000100:00100000:3.0:1787892974.287252:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787892974.287258:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874741455535360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787892974.287298:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874741455535360:12345-0@lo:400:kworker.0 Request processed in 40us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892974.287304:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787892974.287316:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787892974.287322:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874741455534976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787892974.287349:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874741455534976:12345-0@lo:400:kworker.0 Request processed in 27us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892974.287354:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1787892974.287378:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787892974.287383:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787892974.287400:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137f7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874741455534976:0@lo:400:kworker.0 00000100:00100000:3.0:1787892974.287410:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137f7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874741455535360:0@lo:400:kworker.0 00000001:00100000:1.0:1787892974.320787:0:6725:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of db96701a-d972-4021-b77b-4d58b82fa12c 00000020:00000080:1.0:1787892974.320798:0:6725:0:(genops.c:885:class_export_put()) final put ffff90712c5fd000/db96701a-d972-4021-b77b-4d58b82fa12c 00000020:00000080:3.0:1787892974.320873:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90712c5fd000/db96701a-d972-4021-b77b-4d58b82fa12c for lustre-OST0000 00000020:00000080:3.0:1787892974.320930:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90712c5f9800 for lustre-OST0000 00010000:00010000:2.0:1787892974.665171:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787892974.792964:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787892974.792999:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907003899500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455535616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787892974.793073:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892974.793240:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455535616 00000100:00100000:3.0:1787892974.793250:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455535616 00000100:00100000:3.0:1787892974.793309:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787892974.793320:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e5c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455535616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787892974.793376:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787892974.793439:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e5c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455535616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892974.793448:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1787892974.793536:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff907003899500 x1874741455535616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892990 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892974.793556:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907003899500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455535616:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787892975.690315:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787892976.715183:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787892977.203046:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892977.203104:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892977.203138:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892977.203169:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431384320 00000100:00100000:3.0:1787892977.203179:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431384320 00000100:00100000:3.0:1787892977.203241:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431384448 00000100:00100000:3.0:1787892977.203244:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431384448 00000100:00100000:3.0:1787892977.203270:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 86 00000100:00100000:3.0:1787892977.203280:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907003899f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+6:2361:x1874741431384320:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1787892977.203358:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907003899f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+6:2361:x1874741431384320:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 79us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892977.203366:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 86 00000100:00100000:3.0:1787892977.203382:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 87 00000100:00100000:3.0:1787892977.203389:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907003898700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db96701a-d972-4021-b77b-4d58b82fa12c+5:2361:x1874741431384448:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1787892977.203413:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907003898700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db96701a-d972-4021-b77b-4d58b82fa12c+5:2361:x1874741431384448:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 25us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892977.203419:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 87 00000100:00080000:3.0:1787892977.203434:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787892977.204174:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431384192 00000100:00100000:1.0:1787892977.204182:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431384192 00000100:00100000:1.0:1787892977.204231:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 227 00000100:00100000:1.0:1787892977.204241:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+13:2361:x1874741431384192:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1787892977.204297:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+13:2361:x1874741431384192:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 58us (1192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892977.204306:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 227 00010000:00010000:3.0:1787892977.738089:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787892978.078564:0:11175:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc9ce46b70 20000000:00000080:3.0:1787892978.078583:0:11175:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90713f4b8c00 uarg=0000000000000000 20000000:01000000:3.0:1787892978.078626:0:11175:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787892978.078632:0:11175:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787892978.078638:0:11175:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787892978.085056:0:11176:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1787892978.085450:0:11175:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787892978.095140:0:11175:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787892978.095178:0:11175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907104f46200/0x825e3f5022b4a76a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892978.095201:0:11175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907104f47c00/0x825e3f5022b4a716 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a70f expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892978.095209:0:11175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907103f06800/0x825e3f5022b4a724 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a71d expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892978.095217:0:11175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907104f46000/0x825e3f5022b4a732 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a72b expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892978.095228:0:11175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9071102b9600/0x825e3f5022b4a739 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae06 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892978.095236:0:11175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9071421fa600/0x825e3f5022b4a74e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae3e expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892978.095245:0:11175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907104f46200/0x825e3f5022b4a76a lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892978.095300:0:11175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9071421fa600/0x825e3f5022b4a74e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae3e expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892978.095318:0:11175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9071421fa600/0x825e3f5022b4a74e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae3e expref: 12 pid: 5842 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892978.095353:0:11175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907003898e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11175:1874741455535744:192.168.202.29@tcp:104: 00010000:00010000:3.0:1787892978.095498:0:11175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9071102b9600/0x825e3f5022b4a739 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae06 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892978.095507:0:11175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9071102b9600/0x825e3f5022b4a739 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae06 expref: 12 pid: 5843 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892978.095516:0:11175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700389bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11175:1874741455535872:192.168.202.29@tcp:104: 00010000:00010000:3.0:1787892978.095548:0:11175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907104f46000/0x825e3f5022b4a732 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x825e3f5022b4a72b expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892978.095556:0:11175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907104f46000/0x825e3f5022b4a732 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x825e3f5022b4a72b expref: 18 pid: 5841 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892978.095565:0:11175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907003898000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11175:1874741455536000:0@lo:104: 00000100:00100000:3.0:1787892978.095607:0:11175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787892978.096383:0:11175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907103f06800/0x825e3f5022b4a724 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x825e3f5022b4a71d expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892978.096399:0:11175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907103f06800/0x825e3f5022b4a724 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x825e3f5022b4a71d expref: 18 pid: 5841 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892978.096409:0:11175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137f7c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11175:1874741455536128:0@lo:104: 00000100:00100000:3.0:1787892978.096439:0:11175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787892978.098627:0:11175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907104f47c00/0x825e3f5022b4a716 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x825e3f5022b4a70f expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892978.098646:0:11175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907104f47c00/0x825e3f5022b4a716 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x825e3f5022b4a70f expref: 18 pid: 5842 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892978.098676:0:11175:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137f7ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11175:1874741455536256:0@lo:104: 00000100:00100000:3.0:1787892978.098747:0:11175:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892978.100740:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455536000 00000100:00100000:0.0:1787892978.100768:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455536000 00000100:00100000:1.0:1787892978.100788:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787892978.100816:0:8462:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455536128 00000100:00100000:1.0:1787892978.100818:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787892978.100820:0:8462:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455536128 00000100:00100000:0.0:1787892978.101103:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787892978.101118:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907003899500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:22d910cf-711e-44e0-9acf-212404ada550+4:11175:x1874741455536000:12345-0@lo:104: 00010000:00010000:0.0:1787892978.101138:0:8462:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9071102b8200/0x825e3f5022b4a72b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a732 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892978.101212:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787892978.101219:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907003899500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:22d910cf-711e-44e0-9acf-212404ada550+4:11175:x1874741455536000:12345-0@lo:104: Request processed in 105us (5613us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892978.101289:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787892978.101310:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787892978.101316:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137f7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:22d910cf-711e-44e0-9acf-212404ada550+3:11175:x1874741455536128:12345-0@lo:104: 00010000:00010000:0.0:1787892978.101324:0:8462:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9071102b9c00/0x825e3f5022b4a71d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a724 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892978.101381:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787892978.101386:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137f7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:22d910cf-711e-44e0-9acf-212404ada550+3:11175:x1874741455536128:12345-0@lo:104: Request processed in 71us (4947us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892978.101393:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1787892978.101662:0:7644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787892978.101670:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9071102b8200/0x825e3f5022b4a72b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a732 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892978.101684:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071102b8200 already unused, calling callback (ffffffffc1c05c20) 10000000:00010000:1.0:1787892978.101688:0:7644:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9071102b8200/0x825e3f5022b4a72b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x825e3f5022b4a732 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892978.101697:0:7644:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9071102b8200/0x825e3f5022b4a72b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x825e3f5022b4a732 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787892978.101705:0:7644:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9071102b8200/0x825e3f5022b4a72b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x825e3f5022b4a732 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787892978.101710:0:7644:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787892978.101774:0:7644:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9071102b8200/0x825e3f5022b4a72b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a732 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892978.101780:0:7644:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787892978.101800:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9071102b8200/0x825e3f5022b4a72b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a732 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892978.101807:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9071102b8200/0x825e3f5022b4a72b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a732 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892978.101822:0:7644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787892978.101825:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9071102b9c00/0x825e3f5022b4a71d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a724 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892978.101830:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071102b9c00 already unused, calling callback (ffffffffc1c05c20) 10000000:00010000:1.0:1787892978.101833:0:7644:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9071102b9c00/0x825e3f5022b4a71d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x825e3f5022b4a724 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892978.101851:0:7644:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9071102b9c00/0x825e3f5022b4a71d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x825e3f5022b4a724 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787892978.101857:0:7644:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9071102b9c00/0x825e3f5022b4a71d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x825e3f5022b4a724 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787892978.101862:0:7644:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787892978.101877:0:7644:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9071102b9c00/0x825e3f5022b4a71d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a724 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892978.101883:0:7644:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787892978.101900:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9071102b9c00/0x825e3f5022b4a71d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a724 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892978.101907:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9071102b9c00/0x825e3f5022b4a71d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a724 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892978.101917:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892978.101919:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892978.101921:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787892978.101938:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e5c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22d910cf-711e-44e0-9acf-212404ada550:3308:1874741455536384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787892978.102100:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892978.102148:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431384576 00000100:00100000:0.0:1787892978.102154:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431384576 00010000:00010000:0.0:1787892978.102178:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9071421fa600/0x825e3f5022b4a74e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae3e expref: 13 pid: 5842 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892978.102197:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431384704 00000100:00100000:0.0:1787892978.102199:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431384704 00010000:00010000:0.0:1787892978.102208:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9071102b9600/0x825e3f5022b4a739 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae06 expref: 14 pid: 5843 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892978.102216:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455536384 00000100:00100000:0.0:1787892978.102218:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455536384 00010000:00010000:0.0:1787892978.102227:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907104f46000/0x825e3f5022b4a732 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a72b expref: 19 pid: 5841 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892978.102239:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 25 00000100:00100000:0.0:1787892978.102246:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107f2b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:18703558-96be-475d-879f-15397926f758+14:2361:x1874741431384576:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787892978.102258:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787892978.102264:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9071421fa600/0x825e3f5022b4a74e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae3e expref: 14 pid: 5842 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892978.102275:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9071421fa600/0x825e3f5022b4a74e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae3e expref: 14 pid: 5842 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892978.102292:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787892978.102353:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e5c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455536512:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787892978.102382:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892978.102506:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455536256 00000100:00100000:2.0:1787892978.102518:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455536256 00000100:00100000:1.0:1787892978.102553:0:8462:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787892978.102567:0:8462:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137f7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:22d910cf-711e-44e0-9acf-212404ada550+3:11175:x1874741455536256:12345-0@lo:104: 00010000:00010000:1.0:1787892978.102576:0:8462:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff907103f07800/0x825e3f5022b4a70f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a716 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892978.102611:0:11175:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710828d780 going to sleep for 11 seconds 00010000:00010000:1.0:1787892978.102622:0:8462:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787892978.102628:0:8462:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137f7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:22d910cf-711e-44e0-9acf-212404ada550+3:11175:x1874741455536256:12345-0@lo:104: Request processed in 65us (3881us total) trans 0 rc 0/0 00010000:00010000:3.0:1787892978.102635:0:11175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9071421fa600/0x825e3f5022b4a74e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae3e expref: 14 pid: 5842 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892978.102647:0:11175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907003898e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11175:1874741455535744:192.168.202.29@tcp:104: 00000100:00100000:3.0:1787892978.102658:0:11175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700389bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11175:1874741455535872:192.168.202.29@tcp:104: 00000100:00100000:3.0:1787892978.102666:0:11175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907003898000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11175:1874741455536000:0@lo:104: 00000100:00100000:3.0:1787892978.102673:0:11175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137f7c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11175:1874741455536128:0@lo:104: 00000100:00100000:3.0:1787892978.102679:0:11175:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137f7ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11175:1874741455536256:0@lo:104: 00000100:00100000:0.0:1787892978.102690:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107f2b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:18703558-96be-475d-879f-15397926f758+13:2361:x1874741431384576:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 446us (1907us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892978.102698:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 25 00010000:00010000:3.0:1787892978.102707:0:11175:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907104f46200/0x825e3f5022b4a76a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892978.102749:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455536512 00000100:00100000:0.0:1787892978.102772:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455536512 00000100:00100000:2.0:1787892978.102776:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 26 00000100:00100000:2.0:1787892978.102784:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e5c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:18703558-96be-475d-879f-15397926f758+12:2361:x1874741431384704:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787892978.102785:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907103f06800/0x825e3f5022b4a724 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a71d expref: 20 pid: 5841 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892978.102792:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787892978.102797:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9071102b9600/0x825e3f5022b4a739 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae06 expref: 12 pid: 5843 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892978.102797:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787892978.102802:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e5c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22d910cf-711e-44e0-9acf-212404ada550+20:3308:x1874741455536384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787892978.102807:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9071102b9600/0x825e3f5022b4a739 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae06 expref: 12 pid: 5843 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892978.102809:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787892978.102812:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907104f46000/0x825e3f5022b4a732 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a72b expref: 20 pid: 5841 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892978.102818:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9071102b9600/0x825e3f5022b4a739 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae06 expref: 12 pid: 5843 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892978.102820:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907104f46000/0x825e3f5022b4a732 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x825e3f5022b4a72b expref: 20 pid: 5841 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892978.102827:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787892978.102831:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907104f46000/0x825e3f5022b4a732 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x825e3f5022b4a72b expref: 20 pid: 5841 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892978.102839:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787892978.102983:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e5c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:18703558-96be-475d-879f-15397926f758+11:2361:x1874741431384704:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 198us (2163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892978.102990:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 26 00000100:00100000:2.0:1787892978.103004:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787892978.103010:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e5c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22d910cf-711e-44e0-9acf-212404ada550+19:3305:x1874741455536512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787892978.103017:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787892978.103021:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907103f06800/0x825e3f5022b4a724 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a71d expref: 19 pid: 5841 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892978.103031:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907103f06800/0x825e3f5022b4a724 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x825e3f5022b4a71d expref: 19 pid: 5841 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892978.103041:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907103f06800/0x825e3f5022b4a724 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x825e3f5022b4a71d expref: 19 pid: 5841 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892978.103062:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787892978.103140:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787892978.103145:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff907103f07800/0x825e3f5022b4a70f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a716 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892978.103153:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907103f07800 already unused, calling callback (ffffffffc1c05c20) 10000000:00010000:3.0:1787892978.103156:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff907103f07800/0x825e3f5022b4a70f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x825e3f5022b4a716 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892978.103164:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff907103f07800/0x825e3f5022b4a70f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x825e3f5022b4a716 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787892978.103171:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff907103f07800/0x825e3f5022b4a70f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x825e3f5022b4a716 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787892978.103183:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787892978.103209:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff907103f07800/0x825e3f5022b4a70f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a716 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892978.103215:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787892978.103234:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff907103f07800/0x825e3f5022b4a70f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a716 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892978.103241:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff907103f07800/0x825e3f5022b4a70f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a716 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892978.103254:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787892978.103256:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787892978.103257:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787892978.103331:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e5c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:22d910cf-711e-44e0-9acf-212404ada550+18:3305:x1874741455536512:12345-0@lo:103:ldlm_bl.0 Request processed in 320us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892978.103338:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787892978.103344:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e5c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22d910cf-711e-44e0-9acf-212404ada550+18:3308:x1874741455536384:12345-0@lo:103:ldlm_bl.0 Request processed in 541us (1244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892978.103351:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787892978.103358:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137f7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22d910cf-711e-44e0-9acf-212404ada550:3306:1874741455536640:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787892978.103387:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892978.103402:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455536640 00000100:00100000:0.0:1787892978.103407:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455536640 00010000:00010000:0.0:1787892978.103421:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907104f47c00/0x825e3f5022b4a716 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a70f expref: 17 pid: 5842 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892978.103442:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787892978.103455:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22d910cf-711e-44e0-9acf-212404ada550+17:3306:x1874741455536640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787892978.103464:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787892978.103468:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907104f47c00/0x825e3f5022b4a716 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a70f expref: 17 pid: 5842 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892978.103477:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907104f47c00/0x825e3f5022b4a716 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x825e3f5022b4a70f expref: 17 pid: 5842 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892978.103488:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907104f47c00/0x825e3f5022b4a716 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x825e3f5022b4a70f expref: 17 pid: 5842 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892978.103498:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff907104f46200/0x825e3f5022b4a76a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892978.103508:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907104f46200/0x825e3f5022b4a76a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892978.103522:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907104f46200/0x825e3f5022b4a76a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892978.103530:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907104f46200/0x825e3f5022b4a76a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892978.103537:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907104f46200/0x825e3f5022b4a76a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892978.103544:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907104f46200/0x825e3f5022b4a76a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892978.103549:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f46200 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:0.0:1787892978.103553:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907104f46200/0x825e3f5022b4a76a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892978.103568:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907104f46200/0x825e3f5022b4a76a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892978.103582:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907104f46200/0x825e3f5022b4a76a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892978.103592:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787892978.103620:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22d910cf-711e-44e0-9acf-212404ada550+16:3306:x1874741455536640:12345-0@lo:103:ldlm_bl.0 Request processed in 165us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892978.103626:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787892978.103693:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137f7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22d910cf-711e-44e0-9acf-212404ada550:3306:1874741455536640:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787892978.103786:0:8462:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1787892978.103805:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787892978.103820:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e5c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455536512:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787892978.104612:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e5c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22d910cf-711e-44e0-9acf-212404ada550:3308:1874741455536384:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787892978.105965:0:11175:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907104f46200/0x825e3f5022b4a76a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892978.105981:0:11175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907104f46200/0x825e3f5022b4a76a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892978.105989:0:11175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907104f46200/0x825e3f5022b4a76a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892978.392582:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787892978.392609:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e5c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455536768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787892978.392674:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892978.392743:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455536768 00000100:00100000:3.0:1787892978.392764:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455536768 00000100:00100000:3.0:1787892978.392823:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787892978.392831:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137f7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455536768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787892978.392866:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787892978.392904:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137f7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455536768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892978.392910:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1787892978.392929:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787892978.392965:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90712e5c0e00 x1874741455536768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892994 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892978.392985:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e5c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455536768:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787892978.761038:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787892979.406772:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137f7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22d910cf-711e-44e0-9acf-212404ada550:3308:1874741455536896:0@lo:400:kworker.0 00000100:00100000:3.0:1787892979.406842:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892979.406890:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700389bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874741455537408:0@lo:400:kworker.0 00000100:00100000:3.0:1787892979.406947:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892979.406974:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787892979.406981:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907003898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455537280:0@lo:400:kworker.0 00000100:00100000:3.0:1787892979.407006:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892979.407032:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137f7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874741455537024:0@lo:400:kworker.0 00000100:00100000:2.0:1787892979.407361:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137f7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874741455537152:0@lo:400:kworker.0 00000100:00100000:1.0:1787892979.410419:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455537280 00000100:00100000:1.0:1787892979.410438:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455537280 00000100:00100000:1.0:1787892979.410516:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787892979.410527:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137e49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455537280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787892979.412025:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455537408 00000100:00100000:0.0:1787892979.412041:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455537408 00000100:00100000:0.0:1787892979.412112:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787892979.412125:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137e49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874741455537408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787892979.415082:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892979.415918:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455537152 00000100:00100000:2.0:1787892979.415930:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455537152 00000100:00100000:2.0:1787892979.416012:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787892979.416023:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874741455537152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787892979.416437:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874741455537152:12345-0@lo:400:kworker.0 Request processed in 414us (1362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892979.416446:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787892979.416496:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137f7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874741455537152:0@lo:400:kworker.0 00000100:00100000:3.0:1787892979.429874:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892979.429955:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907003898e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455537536:0@lo:400:kworker.0 00000100:00100000:3.0:1787892979.430025:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892979.431828:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137e49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455537280:12345-0@lo:400:kworker.0 Request processed in 21292us (24810us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892979.431844:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787892979.431878:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455537536 00000100:00100000:1.0:1787892979.431886:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455537536 00000100:00100000:1.0:1787892979.431949:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787892979.431960:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137e4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455537536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787892979.432022:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137e4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455537536:12345-0@lo:400:kworker.0 Request processed in 64us (1996us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892979.432029:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787892979.432059:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455536896 00000100:00100000:1.0:1787892979.432064:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455536896 00000100:00100000:1.0:1787892979.432091:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787892979.432098:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+16:3308:x1874741455536896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787892979.432132:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+16:3308:x1874741455536896:12345-0@lo:400:kworker.0 Request processed in 35us (25291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892979.432147:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787892979.432231:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455537024 00000100:00100000:1.0:1787892979.432237:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455537024 00000100:00100000:1.0:1787892979.432258:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787892979.432264:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137e48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874741455537024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787892979.432298:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137e48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874741455537024:12345-0@lo:400:kworker.0 Request processed in 34us (2433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892979.432304:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:1.0:1787892979.432338:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787892979.432344:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787892979.432749:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137e49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874741455537408:12345-0@lo:400:kworker.0 Request processed in 20625us (25799us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892979.432779:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:2.0:1787892979.433808:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff907003898000 x1874741455537280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892979.433826:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907003898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455537280:0@lo:400:kworker.0 00000100:00100000:2.0:1787892979.433840:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137f7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22d910cf-711e-44e0-9acf-212404ada550:3308:1874741455536896:0@lo:400:kworker.0 00000100:00100000:2.0:1787892979.433853:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700389bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874741455537408:0@lo:400:kworker.0 00000100:00100000:2.0:1787892979.433919:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137f7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874741455537024:0@lo:400:kworker.0 00010000:00080000:2.0:1787892979.433932:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff907003898e00 x1874741455537536/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787892995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892979.434725:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907003898e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455537536:0@lo:400:kworker.0 00000100:00100000:1.0:1787892979.701240:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787892979.701395:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431384832 00000100:00100000:0.0:1787892979.701407:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431384832 00000100:00100000:0.0:1787892979.701501:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 229 00000100:00100000:0.0:1787892979.701512:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+11:5604:x1874741431384832:12345-192.168.202.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787892979.701530:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787892979.701551:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907103f06400/0x825e3f5022b4a771 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821ae68 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892979.701583:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907103f06400/0x825e3f5022b4a771 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae68 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892979.701615:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907103f06400/0x825e3f5022b4a771 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae68 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892979.701624:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907103f06400, rc 0) 00000100:00100000:0.0:1787892979.701685:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+12:5604:x1874741431384832:12345-192.168.202.29@tcp:101:ll_cfg_requeue.0 Request processed in 174us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892979.701692:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 229 00000100:00100000:2.0:1787892979.712708:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892979.716076:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431384960 00000100:00100000:3.0:1787892979.716088:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431384960 00000100:00100000:3.0:1787892979.716155:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 230 00000100:00100000:3.0:1787892979.716165:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+12:5604:x1874741431384960:12345-192.168.202.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787892979.716463:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+12:5604:x1874741431384960:12345-192.168.202.29@tcp:501:ll_cfg_requeue.0 Request processed in 298us (3765us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892979.716471:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 230 00000100:00100000:0.0:1787892979.719132:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892979.719210:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431385088 00000100:00100000:3.0:1787892979.719221:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431385088 00000100:00100000:3.0:1787892979.719273:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 231 00000100:00100000:3.0:1787892979.719284:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+12:5604:x1874741431385088:12345-192.168.202.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787892979.719716:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+12:5604:x1874741431385088:12345-192.168.202.29@tcp:503:ll_cfg_requeue.0 Request processed in 432us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892979.719725:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 231 00000100:00100000:2.0:1787892979.736910:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892979.738120:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431385216 00000100:00100000:3.0:1787892979.738135:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431385216 00000100:00100000:3.0:1787892979.738203:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 232 00000100:00100000:3.0:1787892979.738214:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+12:5604:x1874741431385216:12345-192.168.202.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787892979.738232:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787892979.738252:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907104f46200/0x825e3f5022b4a778 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821ae6f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892979.738284:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907104f46200/0x825e3f5022b4a778 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae6f expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892979.738295:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907104f46200/0x825e3f5022b4a778 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae6f expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892979.738306:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907104f46200, rc 0) 00000100:00100000:3.0:1787892979.738373:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+13:5604:x1874741431385216:12345-192.168.202.29@tcp:101:ll_cfg_requeue.0 Request processed in 161us (1485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892979.738388:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 232 00000100:00100000:3.0:1787892979.750629:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787892979.750804:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431385344 00000100:00100000:1.0:1787892979.750824:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431385344 00000100:00100000:1.0:1787892979.750876:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 233 00000100:00100000:1.0:1787892979.750885:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+13:5604:x1874741431385344:12345-192.168.202.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787892979.751399:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+13:5604:x1874741431385344:12345-192.168.202.29@tcp:501:ll_cfg_requeue.0 Request processed in 510us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892979.751409:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 233 00000100:00100000:1.0:1787892979.764021:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892979.772043:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431385472 00000100:00100000:3.0:1787892979.772062:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431385472 00000100:00100000:2.0:1787892979.774139:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 234 00000100:00100000:2.0:1787892979.774154:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+13:5604:x1874741431385472:12345-192.168.202.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787892979.774390:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+13:5604:x1874741431385472:12345-192.168.202.29@tcp:503:ll_cfg_requeue.0 Request processed in 238us (10377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892979.774399:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 234 00010000:00010000:3.0:1787892979.785118:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787892979.914487:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137e4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455537664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787892979.914573:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892979.914655:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455537664 00000100:00100000:3.0:1787892979.914663:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455537664 00000100:00100000:3.0:1787892979.914710:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787892979.914719:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137e49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455537664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787892979.914782:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787892979.914831:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137e49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455537664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892979.914839:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1787892979.914881:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff907137e4b800 x1874741455537664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892995 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892979.914900:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137e4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455537664:0@lo:13:osp-pre-1-0.0 10000000:01000000:1.0:1787892979.923288:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787892979.925731:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9071072cc000 from 7 10000000:01000000:1.0:1787892979.925737:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787892979.925807:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9071421fb600/0x825e3f5022b4a77f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892979.925820:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9071421fb600/0x825e3f5022b4a77f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892979.925844:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9071421fb600/0x825e3f5022b4a77f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892979.925869:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e5c0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455537792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787892979.925962:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892979.926013:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff90713f545d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787892979.926130:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455537792 00000100:00100000:0.0:1787892979.926141:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455537792 00000100:00100000:0.0:1787892979.926202:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1787892979.926212:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+16:5846:x1874741455537792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787892979.926226:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787892979.926243:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907103f07a00/0x825e3f5022b4a786 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4a77f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892979.926276:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907103f07a00/0x825e3f5022b4a786 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4a77f expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892979.926286:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907103f07a00/0x825e3f5022b4a786 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a77f expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892979.926302:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907103f07a00, rc 0) 00000100:00100000:0.0:1787892979.926363:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+17:5846:x1874741455537792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892979.926371:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1787892979.926510:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e5c0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455537792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787892979.926526:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9071421fb600/0x825e3f5022b4a77f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a786 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892979.926536:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9071421fb600/0x825e3f5022b4a77f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a786 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892979.926610:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f4d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455537920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787892979.926638:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892979.926667:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff907002c153c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787892979.927015:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455537920 00000100:00100000:1.0:1787892979.927021:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455537920 00000100:00100000:1.0:1787892979.927055:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787892979.927063:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+17:5846:x1874741455537920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787892979.927375:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+17:5846:x1874741455537920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 312us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892979.927383:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787892979.927410:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f4d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455537920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787892979.927454:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f4d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455538048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787892979.927498:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892979.927527:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff907002c153c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787892979.927670:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455538048 00000100:00100000:0.0:1787892979.927682:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455538048 00000100:00100000:0.0:1787892979.927717:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1787892979.927724:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+17:5846:x1874741455538048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787892979.928637:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+17:5846:x1874741455538048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 906us (1130us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892979.928647:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787892979.929215:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f4d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455538048:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787892979.934662:0:11213:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787892979.934980:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787892979.935005:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787892979.935016:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9071421fb600/0x825e3f5022b4a77f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a786 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892979.935029:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9071421fb600/0x825e3f5022b4a77f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a786 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787892979.935058:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787892979.935061:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff907105af0000 from 7 10000000:01000000:3.0:1787892979.935064:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787892979.935102:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff907104f47200/0x825e3f5022b4a78d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892979.935109:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff907104f47200/0x825e3f5022b4a78d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892979.935119:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff907104f47200/0x825e3f5022b4a78d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892979.935147:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137e4b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455538176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787892979.935223:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892979.935542:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff90713f4dac00 going to sleep for 11 seconds 00000100:00100000:1.0:1787892979.938085:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455538176 00000100:00100000:1.0:1787892979.938103:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455538176 00000100:00100000:0.0:1787892979.938228:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787892979.938242:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+17:5846:x1874741455538176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787892979.938270:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787892979.938292:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907103f07600/0x825e3f5022b4a794 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4a78d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892979.938321:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907103f07600/0x825e3f5022b4a794 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4a78d expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892979.938332:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907103f07600/0x825e3f5022b4a794 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a78d expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892979.938342:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907103f07600, rc 0) 00000100:00100000:0.0:1787892979.938427:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+18:5846:x1874741455538176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 188us (3203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892979.938434:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1787892979.938584:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137e4b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455538176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787892979.938607:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff907104f47200/0x825e3f5022b4a78d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a794 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892979.938618:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff907104f47200/0x825e3f5022b4a78d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a794 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892979.938688:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e5c0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455538304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787892979.938733:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892979.938798:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff90713f545840 going to sleep for 11 seconds 00000100:00100000:2.0:1787892979.938856:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455538304 00000100:00100000:2.0:1787892979.938861:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455538304 00000100:00100000:2.0:1787892979.938908:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787892979.938916:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+18:5846:x1874741455538304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787892979.939182:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+18:5846:x1874741455538304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 266us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892979.939189:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1787892979.939523:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e5c0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455538304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787892979.939557:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e5c0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455538432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787892979.939600:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892979.939629:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff90713f545840 going to sleep for 11 seconds 00000100:00100000:1.0:1787892979.939643:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455538432 00000100:00100000:1.0:1787892979.939650:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455538432 00000100:00100000:1.0:1787892979.939687:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1787892979.939694:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+18:5846:x1874741455538432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787892979.939876:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+18:5846:x1874741455538432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 182us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892979.939883:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1787892979.939922:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e5c0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455538432:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787892979.941603:0:11215:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787892979.946377:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787892979.946421:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787892979.946434:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff907104f47200/0x825e3f5022b4a78d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a794 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892979.946447:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff907104f47200/0x825e3f5022b4a78d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a794 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787892979.950732:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787892979.950742:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90710510c800 from 7 10000000:01000000:2.0:1787892979.950747:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787892979.950813:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9071102b9200/0x825e3f5022b4a79b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892979.950826:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9071102b9200/0x825e3f5022b4a79b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892979.950837:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9071102b9200/0x825e3f5022b4a79b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892979.950861:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f4d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455538560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787892979.950948:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892979.950996:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff907002c15540 going to sleep for 11 seconds 00000100:00100000:0.0:1787892979.951063:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455538560 00000100:00100000:0.0:1787892979.951070:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455538560 00000100:00100000:0.0:1787892979.951125:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1787892979.951135:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+18:5846:x1874741455538560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787892979.951148:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787892979.951161:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907103f07200/0x825e3f5022b4a7a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4a79b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892979.951182:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907103f07200/0x825e3f5022b4a7a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4a79b expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892979.951194:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907103f07200/0x825e3f5022b4a7a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a79b expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892979.951203:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907103f07200, rc 0) 00000100:00100000:0.0:1787892979.951247:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+19:5846:x1874741455538560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892979.951254:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787892979.951392:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f4d1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455538560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787892979.951410:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9071102b9200/0x825e3f5022b4a79b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a7a2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892979.951419:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9071102b9200/0x825e3f5022b4a79b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a7a2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892979.951472:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137e49f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455538688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787892979.951501:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892979.951529:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff90713f4da540 going to sleep for 11 seconds 00000100:00100000:2.0:1787892979.951569:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455538688 00000100:00100000:2.0:1787892979.951574:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455538688 00000100:00100000:2.0:1787892979.951596:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787892979.951603:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+19:5846:x1874741455538688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787892979.951907:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+19:5846:x1874741455538688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 303us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892979.951921:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787892979.951965:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137e49f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455538688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787892979.951994:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f4d1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455538816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787892979.952029:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892979.952042:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff907002c15f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787892979.952055:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455538816 00000100:00100000:2.0:1787892979.952059:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455538816 00000100:00100000:2.0:1787892979.952079:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787892979.952085:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+19:5846:x1874741455538816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787892979.952219:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+19:5846:x1874741455538816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892979.952226:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787892979.952261:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f4d1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455538816:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787892979.954718:0:11217:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787892979.955065:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787892979.955088:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787892979.955102:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9071102b9200/0x825e3f5022b4a79b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a7a2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892979.955116:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9071102b9200/0x825e3f5022b4a79b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a7a2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892980.810649:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892981.834717:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787892982.326224:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892982.326449:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431385728 00000100:00100000:3.0:1787892982.326568:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431385728 00000100:00100000:3.0:1787892982.326657:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 91 00000100:00100000:3.0:1787892982.326668:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+6:2360:x1874741431385728:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1787892982.326746:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+6:2360:x1874741431385728:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 80us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892982.326777:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 91 00000100:00080000:0.0:1787892982.329669:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787892982.332610:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787892982.332670:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787892982.332781:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431385856 00000100:00100000:0.0:1787892982.332803:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431385856 00000100:00100000:0.0:1787892982.332892:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 92 00000100:00100000:0.0:1787892982.332902:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e5c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db96701a-d972-4021-b77b-4d58b82fa12c+5:2361:x1874741431385856:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1787892982.333350:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e5c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db96701a-d972-4021-b77b-4d58b82fa12c+5:2361:x1874741431385856:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 448us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892982.333373:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 92 00000100:00080000:1.0:1787892982.333687:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787892982.335111:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431385600 00000100:00100000:3.0:1787892982.335127:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431385600 00000100:00100000:3.0:1787892982.335195:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 244 00000100:00100000:3.0:1787892982.335204:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+13:2361:x1874741431385600:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1787892982.335400:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+13:2361:x1874741431385600:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 195us (2800us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892982.335417:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 244 00010000:00010000:3.0:1787892982.860137:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787892983.097909:0:11373:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg229-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1787892983.497352:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787892983.497376:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e5c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455538944:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787892983.497453:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892983.497562:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455538944 00000100:00100000:1.0:1787892983.497570:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455538944 00000100:00100000:1.0:1787892983.497625:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787892983.497634:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137e48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455538944:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787892983.497649:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1787892983.497671:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787892983.497719:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137e48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455538944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892983.497741:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1787892983.497802:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90712e5c0e00 x1874741455538944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787892999 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892983.497825:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e5c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455538944:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787892983.883990:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787892984.521074:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e5c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22d910cf-711e-44e0-9acf-212404ada550:3308:1874741455539072:0@lo:400:kworker.0 00000100:00100000:1.0:1787892984.521129:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e5c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874741455539200:0@lo:400:kworker.0 00000100:00100000:3.0:1787892984.521162:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892984.521181:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892984.521296:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455539072 00000100:00100000:0.0:1787892984.521306:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455539072 00000100:00100000:2.0:1787892984.521354:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e5c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455539456:0@lo:400:kworker.0 00000100:00100000:0.0:1787892984.521376:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1787892984.521388:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+19:3308:x1874741455539072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787892984.521396:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892984.521448:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+19:3308:x1874741455539072:12345-0@lo:400:kworker.0 Request processed in 62us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892984.521457:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1787892984.521465:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e5c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874741455539328:0@lo:400:kworker.0 00000100:00100000:0.0:1787892984.521493:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455539456 00000100:00100000:0.0:1787892984.521498:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455539456 00000100:00100000:2.0:1787892984.521501:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892984.521532:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787892984.521536:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455539200 00000100:00100000:0.0:1787892984.521541:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455539456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787892984.521542:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455539200 00000100:00100000:0.0:1787892984.521598:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455539456:12345-0@lo:400:kworker.0 Request processed in 58us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892984.521604:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787892984.521643:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455539328 00000100:00100000:0.0:1787892984.521647:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455539328 00000100:00100000:2.0:1787892984.521649:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787892984.521661:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071083a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874741455539200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787892984.521689:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787892984.521700:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874741455539328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787892984.521703:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071083a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874741455539200:12345-0@lo:400:kworker.0 Request processed in 45us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892984.521713:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:2.0:1787892984.521771:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787892984.521771:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874741455539328:12345-0@lo:400:kworker.0 Request processed in 55us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892984.521781:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787892984.522335:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e5c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22d910cf-711e-44e0-9acf-212404ada550:3308:1874741455539072:0@lo:400:kworker.0 00000100:00100000:2.0:1787892984.522358:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9071083a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874741455539584:0@lo:400:kworker.0 00000100:00100000:2.0:1787892984.522387:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892984.522409:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455539584 00000100:00100000:2.0:1787892984.522413:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455539584 00000100:00100000:2.0:1787892984.522443:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787892984.522450:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874741455539584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787892984.522487:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874741455539584:12345-0@lo:400:kworker.0 Request processed in 38us (100us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892984.522494:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:2.0:1787892984.522512:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787892984.530077:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90712e5c0e00 x1874741455539456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892984.530124:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e5c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455539456:0@lo:400:kworker.0 00000100:00100000:2.0:1787892984.530531:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e5c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874741455539328:0@lo:400:kworker.0 00000100:00100000:0.0:1787892984.531468:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9071083a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874741455539584:0@lo:400:kworker.0 00000100:00100000:2.0:1787892984.533418:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e5c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874741455539200:0@lo:400:kworker.0 00000100:00100000:2.0:1787892984.533460:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9071083a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455539712:0@lo:400:kworker.0 00000100:00100000:2.0:1787892984.533538:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892984.534238:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455539712 00000100:00100000:0.0:1787892984.534250:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455539712 00000100:00080000:2.0:1787892984.534306:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787892984.534344:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787892984.534356:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455539712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787892984.534446:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455539712:12345-0@lo:400:kworker.0 Request processed in 93us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892984.534453:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1787892984.534661:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9071083a3b80 x1874741455539712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892984.534675:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9071083a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455539712:0@lo:400:kworker.0 00010000:00010000:1.0:1787892984.905611:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787892985.032967:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787892985.032999:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137e48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455539840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787892985.033072:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892985.033182:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455539840 00000100:00100000:3.0:1787892985.033191:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455539840 00000100:00100000:3.0:1787892985.033255:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787892985.033266:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455539840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787892985.033302:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787892985.033350:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455539840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892985.033357:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1787892985.033590:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff907137e48700 x1874741455539840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893001 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787892985.033609:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137e48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455539840:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787892985.928996:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892986.956941:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787892987.446319:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787892987.446368:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787892987.446396:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787892987.446426:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431386112 00000100:00100000:2.0:1787892987.446436:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431386112 00000100:00100000:3.0:1787892987.446450:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431385984 00000100:00100000:3.0:1787892987.446453:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431385984 00000100:00100000:2.0:1787892987.446488:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431386240 00000100:00100000:2.0:1787892987.446491:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431386240 00000100:00100000:3.0:1787892987.446492:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 246 00000100:00100000:3.0:1787892987.446501:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+13:2360:x1874741431385984:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1787892987.446509:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 96 00000100:00100000:2.0:1787892987.446515:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+6:2360:x1874741431386112:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1787892987.447674:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+6:2360:x1874741431386112:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 1151us (1298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892987.447687:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 96 00000100:00100000:2.0:1787892987.447719:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 97 00000100:00100000:2.0:1787892987.447731:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db96701a-d972-4021-b77b-4d58b82fa12c+5:2360:x1874741431386240:12345-192.168.202.29@tcp:400:kworker.0 00000100:00080000:0.0:1787892987.455279:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787892987.464303:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+13:2360:x1874741431385984:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 17782us (17976us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892987.464325:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 246 00000100:00100000:3.0:1787892987.468568:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db96701a-d972-4021-b77b-4d58b82fa12c+5:2360:x1874741431386240:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 20827us (22157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892987.468585:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 97 00000001:02000400:0.0:1787892987.829112:0:11474:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 00:56:25 (1787892985) === 00010000:00010000:1.0:1787892987.981725:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787892988.178549:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787892988.178655:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892988.178786:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431386496 00000100:00100000:3.0:1787892988.178795:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431386496 00000100:00100000:0.0:1787892988.178826:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431386368 00000100:00100000:0.0:1787892988.178833:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431386368 00000100:00100000:3.0:1787892988.178868:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 0 00000100:00100000:3.0:1787892988.178879:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4829748d-dde1-497a-9623-0e4326f0972c+7:9682:x1874741431386496:12345-192.168.202.29@tcp:700:mkdir.0 00000100:00100000:0.0:1787892988.178888:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 14 00000100:00100000:0.0:1787892988.178899:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+7:2363:x1874741431386368:12345-192.168.202.29@tcp:41:mkdir.0 00000004:00000024:0.0:1787892988.178939:0:8281:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787892988.178960:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4829748d-dde1-497a-9623-0e4326f0972c+7:9682:x1874741431386496:12345-192.168.202.29@tcp:700:mkdir.0 Request processed in 84us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892988.178965:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 0 00000100:00100000:0.0:1787892988.179044:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+6:2363:x1874741431386368:12345-192.168.202.29@tcp:41:mkdir.0 Request processed in 148us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892988.179065:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 14 00000100:00100000:1.0:1787892988.183693:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787892988.184096:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431386752 00000100:00100000:0.0:1787892988.184108:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431386752 00000100:00100000:0.0:1787892988.184384:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 15 00000100:00100000:0.0:1787892988.184395:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071083a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+6:9682:x1874741431386752:12345-192.168.202.29@tcp:36:mkdir.0 00010000:00010000:0.0:1787892988.184461:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787892988.185123:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4a68a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821adf1 expref: 6 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.185150:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907105cffd00) 00010000:00010000:0.0:1787892988.185377:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787892988.195936:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9000/0x825e3f5022b4a7a9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.195965:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9000/0x825e3f5022b4a7a9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.196939:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9000/0x825e3f5022b4a7a9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.197268:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8200/0x825e3f5022b4a7b0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.197280:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8200/0x825e3f5022b4a7b0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.197287:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8200/0x825e3f5022b4a7b0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787892988.207650:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787892988.207677:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9000/0x825e3f5022b4a7a9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.207689:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9000/0x825e3f5022b4a7a9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.207696:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9000/0x825e3f5022b4a7a9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.207703:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071102b9000 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787892988.207707:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9000/0x825e3f5022b4a7a9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.207715:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9000/0x825e3f5022b4a7a9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.207732:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907105cffa00) 00010000:00010000:2.0:1787892988.207736:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787892988.208909:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9000/0x825e3f5022b4a7a9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.208926:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9000/0x825e3f5022b4a7a9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787892988.208960:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000080bf12b5 reply state 000000003bc09f41 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8200/0x825e3f5022b4a7b0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892988.208970:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787892988.209806:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071083a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+7:9682:x1874741431386752:12345-192.168.202.29@tcp:36:mkdir.0 Request processed in 25406us (26122us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787892988.209818:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 15 00010000:00010000:3.0:1787892988.231740:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8200/0x825e3f5022b4a7b0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.231787:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8200/0x825e3f5022b4a7b0 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.231794:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8200/0x825e3f5022b4a7b0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.231800:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071102b8200 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787892988.231804:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8200/0x825e3f5022b4a7b0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.231826:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8200/0x825e3f5022b4a7b0 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.231846:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff907105cffc00) 00010000:00010000:3.0:1787892988.231849:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787892988.234100:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8200/0x825e3f5022b4a7b0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.234121:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8200/0x825e3f5022b4a7b0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892988.255330:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787892988.255464:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431386880 00000100:00100000:0.0:1787892988.255478:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431386880 00000100:00100000:0.0:1787892988.255555:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 16 00000100:00100000:0.0:1787892988.255568:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071083a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+6:9686:x1874741431386880:12345-192.168.202.29@tcp:101:chmod.0 00010000:00010000:0.0:1787892988.255596:0:8281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787892988.255629:0:8281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907103f06200/0x825e3f5022b4a7b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821ae76 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.255721:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07800/0x825e3f5022b4a7be lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.255737:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07800/0x825e3f5022b4a7be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.255778:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07800/0x825e3f5022b4a7be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787892988.255912:0:8281:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787892988.255917:0:8281:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787892988.255977:0:8281:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07800/0x825e3f5022b4a7be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.256011:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907103f06200/0x825e3f5022b4a7b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae76 expref: 8 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.256034:0:8281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07800/0x825e3f5022b4a7be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae76 expref: 7 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.256044:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9071061f7b00) 00010000:00010000:0.0:1787892988.256047:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787892988.256052:0:8281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907103f07800, rc 0) 00000100:00100000:0.0:1787892988.256140:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071083a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+7:9686:x1874741431386880:12345-192.168.202.29@tcp:101:chmod.0 Request processed in 574us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892988.256148:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 16 00000100:00100000:1.0:1787892988.265046:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892988.265137:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431387136 00000100:00100000:3.0:1787892988.265157:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431387136 00000100:00100000:3.0:1787892988.265252:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 17 00000100:00100000:3.0:1787892988.265269:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071083a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+7:9686:x1874741431387136:12345-192.168.202.29@tcp:36:chmod.0 00010000:00010000:3.0:1787892988.265552:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787892988.265592:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07800/0x825e3f5022b4a7be lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae76 expref: 7 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.265619:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9071061f7b00) 00010000:00010000:3.0:1787892988.265635:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787892988.265674:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4a7c5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.265693:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4a7c5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.265704:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4a7c5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787892988.266581:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000038f56e17 reply state 00000000f3e7f041 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4a7c5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892988.266602:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787892988.266621:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787892988.266830:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071083a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+8:9686:x1874741431387136:12345-192.168.202.29@tcp:36:chmod.0 Request processed in 1547us (1775us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787892988.266842:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 17 00010000:00010000:1.0:1787892988.270455:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4a7c5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892988.270481:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4a7c5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892988.270492:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4a7c5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892988.270499:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f47600 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787892988.270504:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4a7c5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892988.270513:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4a7c5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892988.270542:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9071063d7400) 00010000:00010000:1.0:1787892988.270546:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787892988.270550:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4a7c5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892988.270578:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4a7c5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892988.299149:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787892988.302678:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431387264 00000100:00100000:0.0:1787892988.302705:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431387264 00000100:00100000:0.0:1787892988.302983:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 18 00000100:00100000:0.0:1787892988.302998:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071083a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+7:9687:x1874741431387264:12345-192.168.202.29@tcp:101:chown.0 00010000:00010000:0.0:1787892988.303033:0:8281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787892988.303067:0:8281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907103f06200/0x825e3f5022b4a7cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821ae7d expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.303177:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907103f06800/0x825e3f5022b4a7d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.303222:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907103f06800/0x825e3f5022b4a7d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.303237:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907103f06800/0x825e3f5022b4a7d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787892988.303338:0:8281:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787892988.303343:0:8281:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787892988.303403:0:8281:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907103f06800/0x825e3f5022b4a7d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.303437:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907103f06200/0x825e3f5022b4a7cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae7d expref: 9 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.303462:0:8281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907103f06800/0x825e3f5022b4a7d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae7d expref: 8 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.303476:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9071061f7f00) 00010000:00010000:0.0:1787892988.303479:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787892988.303484:0:8281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907103f06800, rc 0) 00000100:00100000:0.0:1787892988.303621:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071083a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+8:9687:x1874741431387264:12345-192.168.202.29@tcp:101:chown.0 Request processed in 624us (4489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892988.303630:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 18 00000100:00100000:2.0:1787892988.307128:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892988.307261:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431387392 00000100:00100000:3.0:1787892988.307278:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431387392 00000100:00100000:3.0:1787892988.307372:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 19 00000100:00100000:3.0:1787892988.307385:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+8:9687:x1874741431387392:12345-192.168.202.29@tcp:101:chown.0 00010000:00010000:3.0:1787892988.307419:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787892988.307448:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46400/0x825e3f5022b4a7da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821ae84 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.307557:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47a00/0x825e3f5022b4a7e1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.307576:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47a00/0x825e3f5022b4a7e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.307590:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47a00/0x825e3f5022b4a7e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.307609:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47000/0x825e3f5022b4a7e8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.307616:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47000/0x825e3f5022b4a7e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.307648:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47000/0x825e3f5022b4a7e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.308024:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4a7ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.308034:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4a7ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.308042:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4a7ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787892988.308094:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:3.0:1787892988.308099:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787892988.308133:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4a7ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.308148:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47a00/0x825e3f5022b4a7e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.308155:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47a00/0x825e3f5022b4a7e1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.308162:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47a00/0x825e3f5022b4a7e1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.308169:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f47a00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787892988.308174:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47a00/0x825e3f5022b4a7e1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.308182:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47a00/0x825e3f5022b4a7e1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.308204:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9071061f7f00) 00010000:00010000:3.0:1787892988.308207:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787892988.308211:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47a00/0x825e3f5022b4a7e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.308219:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47a00/0x825e3f5022b4a7e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.308237:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47000/0x825e3f5022b4a7e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.308244:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47000/0x825e3f5022b4a7e8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.308250:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47000/0x825e3f5022b4a7e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.308256:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f47000 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787892988.308259:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47000/0x825e3f5022b4a7e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.308265:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47000/0x825e3f5022b4a7e8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.308272:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9071063d7f00) 00010000:00010000:3.0:1787892988.308275:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787892988.308278:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47000/0x825e3f5022b4a7e8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.308284:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47000/0x825e3f5022b4a7e8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.308332:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46400/0x825e3f5022b4a7da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae84 expref: 10 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.308347:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4a7ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae84 expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.308356:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9071063d7c00) 00010000:00010000:3.0:1787892988.308358:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787892988.308361:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907104f47800, rc 0) 00000100:00100000:3.0:1787892988.309051:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+9:9687:x1874741431387392:12345-192.168.202.29@tcp:101:chown.0 Request processed in 1656us (1930us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892988.309064:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 19 00000100:00100000:3.0:1787892988.317016:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787892988.317357:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431387648 00000100:00100000:1.0:1787892988.317374:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431387648 00000100:00100000:1.0:1787892988.317468:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 20 00000100:00100000:1.0:1787892988.317482:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+9:9687:x1874741431387648:12345-192.168.202.29@tcp:36:chown.0 00010000:00010000:1.0:1787892988.317579:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787892988.317624:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4a7ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae84 expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892988.317652:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9071063d7c00) 00010000:00010000:1.0:1787892988.317666:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787892988.317704:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4a7f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892988.317720:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4a7f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892988.317731:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4a7f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787892988.371804:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:1.0:1787892988.372176:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ada7bd49 reply state 000000008e9a7bad transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4a7f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892988.372193:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787892988.373076:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:1.0:1787892988.373242:0:5848:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1787892988.373286:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+7:9687:x1874741431387648:12345-192.168.202.29@tcp:36:chown.0 Request processed in 55798us (56282us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787892988.373299:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 20 00010000:00010000:0.0:1787892988.373963:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4a7f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.373976:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4a7f6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.373999:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4a7f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.374017:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fa000 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:0.0:1787892988.374023:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4a7f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.374033:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4a7f6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.374053:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff907105907300) 00010000:00010000:0.0:1787892988.374056:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787892988.374064:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4a7f6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.374071:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4a7f6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892988.399390:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787892988.406500:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431387776 00000100:00100000:2.0:1787892988.406527:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431387776 00000100:00100000:2.0:1787892988.406684:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 21 00000100:00100000:2.0:1787892988.406700:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137e4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+6:9688:x1874741431387776:12345-192.168.202.29@tcp:101:touch.500 00010000:00010000:2.0:1787892988.406740:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787892988.406804:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9c00/0x825e3f5022b4a7fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821ae8b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787892988.419500:0:5847:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 12424us 00010000:00010000:2.0:1787892988.438665:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8000/0x825e3f5022b4a804 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.438693:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8000/0x825e3f5022b4a804 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.438708:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8000/0x825e3f5022b4a804 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.438804:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9600/0x825e3f5022b4a80b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.438814:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9600/0x825e3f5022b4a80b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.438822:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9600/0x825e3f5022b4a80b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.440793:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8400/0x825e3f5022b4a812 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.440815:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8400/0x825e3f5022b4a812 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.440826:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8400/0x825e3f5022b4a812 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787892988.442126:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787892988.442135:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787892988.443448:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8400/0x825e3f5022b4a812 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.443472:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8000/0x825e3f5022b4a804 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.443480:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8000/0x825e3f5022b4a804 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.443487:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8000/0x825e3f5022b4a804 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.443505:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071102b8000 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787892988.443510:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8000/0x825e3f5022b4a804 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.443518:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8000/0x825e3f5022b4a804 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.443538:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9071061f7f00) 00010000:00010000:2.0:1787892988.443541:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787892988.443546:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8000/0x825e3f5022b4a804 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.443553:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8000/0x825e3f5022b4a804 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.443571:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9600/0x825e3f5022b4a80b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.443576:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9600/0x825e3f5022b4a80b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.443582:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9600/0x825e3f5022b4a80b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.443586:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071102b9600 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787892988.443589:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9600/0x825e3f5022b4a80b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.443594:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9600/0x825e3f5022b4a80b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.443611:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff907105cff000) 00010000:00010000:2.0:1787892988.443613:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787892988.443616:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9600/0x825e3f5022b4a80b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.443622:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9600/0x825e3f5022b4a80b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.443677:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9c00/0x825e3f5022b4a7fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae8b expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.443691:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8400/0x825e3f5022b4a812 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae8b expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.443699:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff907105cffa00) 00010000:00010000:2.0:1787892988.443702:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787892988.443704:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071102b8400, rc 0) 00000100:00100000:2.0:1787892988.443818:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137e4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+7:9688:x1874741431387776:12345-192.168.202.29@tcp:101:touch.500 Request processed in 37120us (45063us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892988.443827:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 21 00000100:00100000:1.0:1787892988.455192:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787892988.455374:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431388032 00000100:00100000:2.0:1787892988.455385:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431388032 00000100:00100000:2.0:1787892988.455455:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 22 00000100:00100000:2.0:1787892988.455467:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071083a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+7:9688:x1874741431388032:12345-192.168.202.29@tcp:101:touch.500 00010000:00010000:2.0:1787892988.455490:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787892988.455515:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9c00/0x825e3f5022b4a819 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821ae92 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.455914:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9600/0x825e3f5022b4a820 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.455930:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9600/0x825e3f5022b4a820 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.455943:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9600/0x825e3f5022b4a820 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.455958:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8000/0x825e3f5022b4a827 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.455965:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8000/0x825e3f5022b4a827 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.455972:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8000/0x825e3f5022b4a827 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787892988.456785:0:5849:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1787892988.457092:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9000/0x825e3f5022b4a82e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.457104:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9000/0x825e3f5022b4a82e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.457113:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9000/0x825e3f5022b4a82e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.457143:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9600/0x825e3f5022b4a820 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.457161:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9600/0x825e3f5022b4a820 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.457169:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9600/0x825e3f5022b4a820 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.457175:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071102b9600 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787892988.457180:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9600/0x825e3f5022b4a820 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.457187:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9600/0x825e3f5022b4a820 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.457201:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff907105cffa00) 00010000:00010000:2.0:1787892988.457205:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787892988.457210:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9600/0x825e3f5022b4a820 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.457217:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9600/0x825e3f5022b4a820 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787892988.457230:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007ed1083b reply state 000000009504d4ce transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8000/0x825e3f5022b4a827 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892988.457239:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787892988.457272:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9c00/0x825e3f5022b4a819 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae92 expref: 10 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.457286:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9000/0x825e3f5022b4a82e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae92 expref: 9 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.457306:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff907105cff600) 00010000:00010000:2.0:1787892988.457308:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787892988.457310:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071102b9000, rc 0) 00000100:00100000:2.0:1787892988.457390:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071083a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+10:9688:x1874741431388032:12345-192.168.202.29@tcp:101:touch.500 Request processed in 1924us (2220us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787892988.457399:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 22 00010000:00010000:3.0:1787892988.463098:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8000/0x825e3f5022b4a827 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.463123:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8000/0x825e3f5022b4a827 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.463132:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8000/0x825e3f5022b4a827 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.463141:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071102b8000 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787892988.463148:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8000/0x825e3f5022b4a827 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.463183:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8000/0x825e3f5022b4a827 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.463212:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xbcdd3602 (ffff907105cff000) 00010000:00010000:3.0:1787892988.463215:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787892988.463222:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8000/0x825e3f5022b4a827 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.463229:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8000/0x825e3f5022b4a827 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892988.463316:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787892988.463537:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431388288 00000100:00100000:0.0:1787892988.463548:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431388288 00000100:00100000:0.0:1787892988.463614:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 23 00000100:00100000:0.0:1787892988.463625:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071083a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+9:9688:x1874741431388288:12345-192.168.202.29@tcp:36:touch.500 00010000:00010000:0.0:1787892988.463679:0:8281:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787892988.463701:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9000/0x825e3f5022b4a82e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae92 expref: 9 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.463716:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff907105cff600) 00010000:00010000:0.0:1787892988.463724:0:8281:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787892988.463791:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07c00/0x825e3f5022b4a83c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.463816:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07c00/0x825e3f5022b4a83c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.463823:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07c00/0x825e3f5022b4a83c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787892988.463956:0:8281:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e81d26cb reply state 00000000ed30b226 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07c00/0x825e3f5022b4a83c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892988.463965:0:8281:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787892988.464059:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071083a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+10:9688:x1874741431388288:12345-192.168.202.29@tcp:36:touch.500 Request processed in 437us (768us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787892988.464064:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 23 00000100:00100000:0.0:1787892988.467308:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787892988.467389:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431388416 00000100:00100000:2.0:1787892988.467401:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431388416 00000100:00100000:2.0:1787892988.467461:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 24 00000100:00100000:2.0:1787892988.467472:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+10:9688:x1874741431388416:12345-192.168.202.29@tcp:101:touch.500 00010000:00010000:2.0:1787892988.467505:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787892988.467531:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8200/0x825e3f5022b4a843 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821ae99 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.467609:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8200/0x825e3f5022b4a843 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae99 expref: 11 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.467624:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8200/0x825e3f5022b4a843 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae99 expref: 11 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.467644:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9071061f7400) 00010000:00010000:2.0:1787892988.467648:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787892988.467652:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071102b8200, rc 0) 00000100:00100000:2.0:1787892988.467708:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+11:9688:x1874741431388416:12345-192.168.202.29@tcp:101:touch.500 Request processed in 237us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892988.467735:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 24 00010000:00010000:3.0:1787892988.470428:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07c00/0x825e3f5022b4a83c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.470454:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07c00/0x825e3f5022b4a83c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.470463:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07c00/0x825e3f5022b4a83c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.470470:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907103f07c00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787892988.470475:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07c00/0x825e3f5022b4a83c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.470485:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07c00/0x825e3f5022b4a83c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.470511:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9071061f7400) 00010000:00010000:3.0:1787892988.470516:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787892988.470523:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07c00/0x825e3f5022b4a83c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.470561:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07c00/0x825e3f5022b4a83c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892988.474045:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787892988.474144:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431388544 00000100:00100000:0.0:1787892988.474160:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431388544 00000100:00100000:0.0:1787892988.474239:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 16 00000100:00100000:0.0:1787892988.474249:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071083a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2359:x1874741431388544:12345-192.168.202.29@tcp:8:touch.500 00010000:00080000:0.0:1787892988.474283:0:8105:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 4829748d-dde1-497a-9623-0e4326f0972c@192.168.202.29@tcp t0 exp 0000000000000000 cur 316 last 0 00000020:00000080:0.0:1787892988.474570:0:8105:0:(genops.c:1385:class_connect()) connect: client 4829748d-dde1-497a-9623-0e4326f0972c, cookie 0x825e3f5022b4a84a 00002000:00100000:0.0:1787892988.474584:0:8105:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4829748d-dde1-497a-9623-0e4326f0972c/ffff90713f9c5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787892988.474608:0:8105:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787892988.475047:0:8105:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787892988.475086:0:8105:0:(import.c:65:import_set_state_nolock()) ffff90713f9c4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787892988.475290:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071083a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4829748d-dde1-497a-9623-0e4326f0972c+6:2359:x1874741431388544:12345-192.168.202.29@tcp:8:touch.500 Request processed in 1039us (1260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892988.475328:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 16 00000100:00100000:1.0:1787892988.483690:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787892988.484093:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431388672 00000100:00100000:2.0:1787892988.484105:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431388672 00000100:00080000:0.0:1787892988.484465:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787892988.484523:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 17 00000100:00100000:2.0:1787892988.484536:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4829748d-dde1-497a-9623-0e4326f0972c+6:0:x1874741431388672:12345-192.168.202.29@tcp:2:touch.500 00000100:00100000:2.0:1787892988.581599:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4829748d-dde1-497a-9623-0e4326f0972c+7:0:x1874741431388672:12345-192.168.202.29@tcp:2:touch.500 Request processed in 97053us (97910us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787892988.581616:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 17 00000001:00100000:1.0:1787892988.581636:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4829748d-dde1-497a-9623-0e4326f0972c 00000001:00080000:1.0:1787892988.581671:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:3.0:1787892988.588806:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787892988.588923:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431388928 00000100:00100000:1.0:1787892988.588935:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431388928 00000100:00100000:1.0:1787892988.589008:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 2 00000100:00100000:1.0:1787892988.589019:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137e48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+10:9688:x1874741431388928:12345-192.168.202.29@tcp:35:touch.500 00000100:00100000:1.0:1787892988.590148:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137e48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+11:9688:x1874741431388928:12345-192.168.202.29@tcp:35:touch.500 Request processed in 1126us (1348us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787892988.590159:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 2 00000100:00100000:2.0:1787892988.618155:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787892988.622145:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787892988.622320:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431389056 00000100:00100000:0.0:1787892988.622331:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431389056 00000100:00100000:0.0:1787892988.622401:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 25 00000100:00100000:0.0:1787892988.622411:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137e4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+11:9689:x1874741431389056:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:0.0:1787892988.622435:0:8281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787892988.622454:0:8281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07000/0x825e3f5022b4a851 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821aea0 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.622692:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907103f06a00/0x825e3f5022b4a858 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.622707:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907103f06a00/0x825e3f5022b4a858 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.622720:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907103f06a00/0x825e3f5022b4a858 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787892988.622821:0:8281:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787892988.622825:0:8281:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787892988.622878:0:8281:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907103f06a00/0x825e3f5022b4a858 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.622906:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07000/0x825e3f5022b4a851 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aea0 expref: 13 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.622924:0:8281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907103f06a00/0x825e3f5022b4a858 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aea0 expref: 12 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.622954:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff907105cffa00) 00010000:00010000:0.0:1787892988.622957:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787892988.622961:0:8281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907103f06a00, rc 0) 00000100:00100000:2.0:1787892988.623369:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455539968:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787892988.623419:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892988.624208:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137e4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+12:9689:x1874741431389056:12345-192.168.202.29@tcp:101:rm.0 Request processed in 1792us (2066us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892988.624218:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 25 00000100:00100000:2.0:1787892988.628973:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455539968 00000100:00100000:2.0:1787892988.628999:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455539968 00000100:00100000:2.0:1787892988.629087:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787892988.629099:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e5c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455539968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787892988.629142:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787892988.629234:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e5c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455539968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (5814us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892988.629242:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1787892988.629289:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff907137d3ca80 x1874741455539968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893004 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787892988.629452:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787892988.629589:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455539968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787892988.638841:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787892988.638975:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431389312 00000100:00100000:2.0:1787892988.638995:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431389312 00000100:00100000:2.0:1787892988.639054:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 26 00000100:00100000:2.0:1787892988.639081:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+12:9689:x1874741431389312:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:2.0:1787892988.639104:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787892988.639124:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9600/0x825e3f5022b4a85f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821aea7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787892988.639251:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787892988.639409:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9600/0x825e3f5022b4a85f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aea7 expref: 14 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.639427:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9071061f7f00) 00010000:00010000:2.0:1787892988.639430:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787892988.639437:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9600/0x825e3f5022b4a85f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aea7 expref: 14 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.639452:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071102b9600, rc 0) 00000100:00100000:2.0:1787892988.639517:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+13:9689:x1874741431389312:12345-192.168.202.29@tcp:101:rm.0 Request processed in 440us (686us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1787892988.639524:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 26 00000100:00100000:3.0:1787892988.657657:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787892988.657739:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431389440 00000100:00100000:2.0:1787892988.657790:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431389440 00000100:00100000:2.0:1787892988.657865:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 3 00000100:00100000:2.0:1787892988.657877:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137e4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+13:9689:x1874741431389440:12345-192.168.202.29@tcp:37:rm.0 00000100:00100000:2.0:1787892988.670150:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137e4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+13:9689:x1874741431389440:12345-192.168.202.29@tcp:37:rm.0 Request processed in 12262us (12495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892988.670164:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 3 00000100:00100000:2.0:1787892988.679570:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787892988.681314:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431389696 00000100:00100000:1.0:1787892988.681327:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431389696 00000100:00100000:1.0:1787892988.681401:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 4 00000100:00100000:1.0:1787892988.681412:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713044c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+13:9689:x1874741431389696:12345-192.168.202.29@tcp:35:rm.0 00000100:00100000:1.0:1787892988.681695:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713044c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+14:9689:x1874741431389696:12345-192.168.202.29@tcp:35:rm.0 Request processed in 284us (2137us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787892988.681703:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 4 00000100:00100000:3.0:1787892988.687986:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787892988.688238:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431389952 00000100:00100000:2.0:1787892988.688266:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431389952 00000100:00100000:2.0:1787892988.688333:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 27 00000100:00100000:2.0:1787892988.688352:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137e48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+14:9689:x1874741431389952:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:2.0:1787892988.688376:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787892988.688398:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4a86d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821aeae expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.688657:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4a874 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.688671:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4a874 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.688682:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4a874 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787892988.688692:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787892988.688932:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4a86d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aeae expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.689082:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4a874 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aeae expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.689092:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff907105cffa00) 00010000:00010000:2.0:1787892988.689094:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787892988.689098:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071102b9a00, rc 0) 00000100:00100000:0.0:1787892988.689266:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137e48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+16:9689:x1874741431389952:12345-192.168.202.29@tcp:101:rm.0 Request processed in 923us (1289us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787892988.689273:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 27 00000100:00100000:3.0:1787892988.701879:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787892988.701952:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431390080 00000100:00100000:2.0:1787892988.701963:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431390080 00000100:00100000:2.0:1787892988.702029:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 28 00000100:00100000:2.0:1787892988.702039:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137e4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+16:9689:x1874741431390080:12345-192.168.202.29@tcp:41:rm.0 00000004:00000024:2.0:1787892988.702109:0:5849:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1787892988.702195:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137e4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+16:9689:x1874741431390080:12345-192.168.202.29@tcp:41:rm.0 Request processed in 157us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892988.702202:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 28 00000100:00100000:2.0:1787892988.706140:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787892988.706323:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431390208 00000100:00100000:0.0:1787892988.706334:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431390208 00000100:00100000:0.0:1787892988.706411:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 29 00000100:00100000:0.0:1787892988.706423:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e5c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+16:9689:x1874741431390208:12345-192.168.202.29@tcp:101:rm.0 00010000:00010000:0.0:1787892988.706445:0:8281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787892988.706467:0:8281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07e00/0x825e3f5022b4a882 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821aeb5 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.706536:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907103f06600/0x825e3f5022b4a889 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.706551:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907103f06600/0x825e3f5022b4a889 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.706564:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907103f06600/0x825e3f5022b4a889 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.706600:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07000/0x825e3f5022b4a890 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.706608:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07000/0x825e3f5022b4a890 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.706614:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07000/0x825e3f5022b4a890 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.706834:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907103f06000/0x825e3f5022b4a897 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.706844:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907103f06000/0x825e3f5022b4a897 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.706859:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907103f06000/0x825e3f5022b4a897 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787892988.706888:0:8281:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787892988.706893:0:8281:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787892988.706917:0:8281:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907103f06000/0x825e3f5022b4a897 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.706930:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907103f06000/0x825e3f5022b4a897 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.706938:0:8281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907103f06600/0x825e3f5022b4a889 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.706945:0:8281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907103f06600/0x825e3f5022b4a889 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.706963:0:8281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907103f06600/0x825e3f5022b4a889 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.706969:0:8281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907103f06600 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:0.0:1787892988.706972:0:8281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907103f06600/0x825e3f5022b4a889 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.706979:0:8281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907103f06600/0x825e3f5022b4a889 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.706990:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff907105cffa00) 00010000:00010000:0.0:1787892988.706994:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787892988.706999:0:8281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907103f06600/0x825e3f5022b4a889 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.707005:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907103f06600/0x825e3f5022b4a889 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.707019:0:8281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07000/0x825e3f5022b4a890 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.707024:0:8281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07000/0x825e3f5022b4a890 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.707029:0:8281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07000/0x825e3f5022b4a890 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.707034:0:8281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907103f07000 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:0.0:1787892988.707037:0:8281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07000/0x825e3f5022b4a890 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.707052:0:8281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07000/0x825e3f5022b4a890 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.707061:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xbcdd3602 (ffff9071061f7a00) 00010000:00010000:0.0:1787892988.707063:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787892988.707066:0:8281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07000/0x825e3f5022b4a890 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.707072:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07000/0x825e3f5022b4a890 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.707105:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07e00/0x825e3f5022b4a882 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aeb5 expref: 18 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.707118:0:8281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907103f06000/0x825e3f5022b4a897 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aeb5 expref: 17 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.707126:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9071061f7400) 00010000:00010000:0.0:1787892988.707128:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787892988.707131:0:8281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907103f06000, rc 0) 00000100:00100000:0.0:1787892988.707212:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e5c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+17:9689:x1874741431390208:12345-192.168.202.29@tcp:101:rm.0 Request processed in 791us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892988.707221:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 29 00000100:00100000:3.0:1787892988.717019:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787892988.717115:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431390464 00000100:00100000:0.0:1787892988.717129:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431390464 00000100:00100000:0.0:1787892988.717201:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 30 00000100:00100000:0.0:1787892988.717212:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137e4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+17:9689:x1874741431390464:12345-192.168.202.29@tcp:36:rm.0 00010000:00010000:0.0:1787892988.717277:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787892988.717321:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907103f06000/0x825e3f5022b4a897 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aeb5 expref: 17 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.717358:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8200/0x825e3f5022b4a843 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae99 expref: 16 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.717372:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9071061f7400) 00010000:00010000:0.0:1787892988.717385:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907103f06a00/0x825e3f5022b4a858 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aea0 expref: 15 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.717393:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff907105cffa00) 00010000:00010000:0.0:1787892988.717396:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787892988.717415:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07c00/0x825e3f5022b4a89e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.717428:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07c00/0x825e3f5022b4a89e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.717437:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07c00/0x825e3f5022b4a89e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.717449:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907103f06200/0x825e3f5022b4a8a5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.717455:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907103f06200/0x825e3f5022b4a8a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.717461:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907103f06200/0x825e3f5022b4a8a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.717601:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07800/0x825e3f5022b4a8ac lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.717617:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07800/0x825e3f5022b4a8ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.717623:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07800/0x825e3f5022b4a8ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787892988.719480:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1787892988.719498:0:5849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 316486744572ns, next at 317486740962ns, rc = 0 00010000:00010000:0.0:1787892988.719608:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4a8b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.719625:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4a8b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.719636:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4a8b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.719645:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4a8b3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.719651:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4a8b3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.719657:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4a8b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.719746:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787892988.719802:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07800/0x825e3f5022b4a8ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.719810:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07800/0x825e3f5022b4a8ac lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.720004:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07800/0x825e3f5022b4a8ac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.720011:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907103f07800 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:0.0:1787892988.720016:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07800/0x825e3f5022b4a8ac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.720025:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07800/0x825e3f5022b4a8ac lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.720039:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9071061f7c00) 00010000:00010000:0.0:1787892988.720043:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787892988.720048:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07800/0x825e3f5022b4a8ac lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.720054:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07800/0x825e3f5022b4a8ac lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.720073:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07c00/0x825e3f5022b4a89e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.720080:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07c00/0x825e3f5022b4a89e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.720085:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07c00/0x825e3f5022b4a89e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.720091:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907103f07c00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:0.0:1787892988.720093:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07c00/0x825e3f5022b4a89e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.720108:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07c00/0x825e3f5022b4a89e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.720117:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff907105cffa00) 00010000:00010000:0.0:1787892988.720119:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787892988.720121:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07c00/0x825e3f5022b4a89e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.720127:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907103f07c00/0x825e3f5022b4a89e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787892988.720135:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008cacf0cd reply state 00000000a22b2acd transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff907103f06200/0x825e3f5022b4a8a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892988.720143:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787892988.720276:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137e4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+16:9689:x1874741431390464:12345-192.168.202.29@tcp:36:rm.0 Request processed in 3062us (3264us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787892988.720284:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 30 00010000:00010000:3.0:1787892988.721137:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787892988.721148:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4a8b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.721156:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc8000 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:3.0:1787892988.721160:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4a8b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.721219:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4a8b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.721232:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9071061f7c00) 00010000:00010000:3.0:1787892988.721234:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787892988.721238:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4a8b3 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.721243:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4a8b3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.721261:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787892988.721262:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787892988.721275:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787892988.725669:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787892988.726355:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431390720 00000100:00100000:2.0:1787892988.726370:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431390720 00000100:00100000:2.0:1787892988.726442:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 5 00000100:00100000:2.0:1787892988.726453:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137e49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+16:9689:x1874741431390720:12345-192.168.202.29@tcp:35:rm.0 00000100:00100000:2.0:1787892988.726731:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137e49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+17:9689:x1874741431390720:12345-192.168.202.29@tcp:35:rm.0 Request processed in 279us (1074us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787892988.726739:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 5 00000100:00100000:3.0:1787892988.729837:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787892988.730006:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431390976 00000100:00100000:2.0:1787892988.730017:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431390976 00000100:00100000:2.0:1787892988.730079:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 31 00000100:00100000:2.0:1787892988.730089:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137e48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+17:9689:x1874741431390976:12345-192.168.202.29@tcp:36:rm.0 00010000:00010000:2.0:1787892988.730163:0:8281:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787892988.730205:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4a874 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aeae expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.730227:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8400/0x825e3f5022b4a812 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae8b expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.730239:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff907105cffa00) 00010000:00010000:2.0:1787892988.730255:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907103f06800/0x825e3f5022b4a7d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae7d expref: 15 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.730285:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9071061f7f00) 00010000:00010000:2.0:1787892988.730293:0:8281:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787892988.730322:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4a8ba lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.730336:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4a8ba lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.730358:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4a8ba lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.730372:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9c00/0x825e3f5022b4a8c1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.730379:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9c00/0x825e3f5022b4a8c1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.730385:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9c00/0x825e3f5022b4a8c1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.730712:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8000/0x825e3f5022b4a8c8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.730722:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8000/0x825e3f5022b4a8c8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.730729:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8000/0x825e3f5022b4a8c8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787892988.731441:0:8281:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787892988.731458:0:8281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8000/0x825e3f5022b4a8c8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.731471:0:8281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8000/0x825e3f5022b4a8c8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.731479:0:8281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8000/0x825e3f5022b4a8c8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.731485:0:8281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071102b8000 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787892988.731490:0:8281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8000/0x825e3f5022b4a8c8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.731498:0:8281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8000/0x825e3f5022b4a8c8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.731510:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff907105cfff00) 00010000:00010000:2.0:1787892988.731513:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787892988.731518:0:8281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8000/0x825e3f5022b4a8c8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.731524:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8000/0x825e3f5022b4a8c8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.731544:0:8281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4a8ba lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.731550:0:8281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4a8ba lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.731555:0:8281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4a8ba lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.731560:0:8281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071102b8e00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787892988.731568:0:8281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4a8ba lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.731575:0:8281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4a8ba lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.731585:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907105cffe00) 00010000:00010000:2.0:1787892988.731587:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787892988.731590:0:8281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4a8ba lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892988.731595:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4a8ba lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787892988.731608:0:8281:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000596dd5ae reply state 00000000733668e6 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9c00/0x825e3f5022b4a8c1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892988.731616:0:8281:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787892988.731708:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137e48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+16:9689:x1874741431390976:12345-192.168.202.29@tcp:36:rm.0 Request processed in 1617us (1879us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787892988.731718:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 31 00010000:00010000:3.0:1787892988.737956:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9c00/0x825e3f5022b4a8c1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.737977:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9c00/0x825e3f5022b4a8c1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.737986:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9c00/0x825e3f5022b4a8c1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.737993:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071102b9c00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787892988.737998:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9c00/0x825e3f5022b4a8c1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.738006:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9c00/0x825e3f5022b4a8c1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.738024:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff907105cff700) 00010000:00010000:3.0:1787892988.738028:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787892988.738033:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9c00/0x825e3f5022b4a8c1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892988.738040:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9c00/0x825e3f5022b4a8c1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.740093:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907103f06200/0x825e3f5022b4a8a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.740111:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907103f06200/0x825e3f5022b4a8a5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.740118:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907103f06200/0x825e3f5022b4a8a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.740124:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907103f06200 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:0.0:1787892988.740129:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907103f06200/0x825e3f5022b4a8a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.740160:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907103f06200/0x825e3f5022b4a8a5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.740189:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xbcdd3602 (ffff9071061f7d00) 00010000:00010000:0.0:1787892988.740192:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787892988.740197:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907103f06200/0x825e3f5022b4a8a5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892988.740204:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907103f06200/0x825e3f5022b4a8a5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892989.001470:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787892989.641217:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874741455540352:0@lo:400:kworker.0 00000100:00100000:1.0:1787892989.641312:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892989.641402:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787892989.641408:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874741455540224:0@lo:400:kworker.0 00000100:00100000:1.0:1787892989.641432:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892989.641447:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455540736:0@lo:400:kworker.0 00000100:00100000:1.0:1787892989.641482:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892989.641523:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455540736 00000100:00100000:1.0:1787892989.641531:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455540736 00000100:00100000:2.0:1787892989.641532:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455540352 00000100:00100000:2.0:1787892989.641535:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455540352 00000100:00100000:2.0:1787892989.641576:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455540224 00000100:00100000:2.0:1787892989.641578:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455540224 00000100:00100000:1.0:1787892989.641580:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787892989.641591:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455540736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787892989.641593:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787892989.641599:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874741455540352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787892989.641641:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874741455540352:12345-0@lo:400:kworker.0 Request processed in 42us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892989.641649:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787892989.641665:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787892989.641673:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22d910cf-711e-44e0-9acf-212404ada550:3308:1874741455540096:0@lo:400:kworker.0 00000100:00100000:2.0:1787892989.641678:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874741455540224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787892989.641715:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892989.641738:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874741455540608:0@lo:400:kworker.0 00000100:00100000:3.0:1787892989.641774:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892989.641776:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455540096 00000100:00100000:0.0:1787892989.641780:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455540096 00000100:00100000:3.0:1787892989.641795:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787892989.641801:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455540480:0@lo:400:kworker.0 00000100:00100000:0.0:1787892989.641805:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1787892989.641812:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+19:3308:x1874741455540096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787892989.641837:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892989.641853:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+19:3308:x1874741455540096:12345-0@lo:400:kworker.0 Request processed in 42us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892989.641860:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1787892989.641877:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22d910cf-711e-44e0-9acf-212404ada550:3308:1874741455540096:0@lo:400:kworker.0 00000100:00100000:3.0:1787892989.641903:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455540608 00000100:00100000:3.0:1787892989.641906:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455540608 00000100:00100000:3.0:1787892989.641927:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787892989.641932:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137e4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874741455540608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787892989.641966:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137e4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874741455540608:12345-0@lo:400:kworker.0 Request processed in 34us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892989.641973:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787892989.641998:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874741455540608:0@lo:400:kworker.0 00000100:00100000:3.0:1787892989.642036:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455540480 00000100:00100000:3.0:1787892989.642039:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455540480 00000100:00100000:3.0:1787892989.642065:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787892989.642072:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137e48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455540480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787892989.642110:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137e48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455540480:12345-0@lo:400:kworker.0 Request processed in 38us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892989.642116:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1787892989.642136:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787892989.642139:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787892989.642154:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff907137d3c000 x1874741455540480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893005 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892989.642165:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455540480:0@lo:400:kworker.0 00000100:00100000:1.0:1787892989.642310:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455540736:12345-0@lo:400:kworker.0 Request processed in 721us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892989.642317:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787892989.643771:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874741455540224:12345-0@lo:400:kworker.0 Request processed in 2073us (2316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892989.643784:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787892989.643977:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874741455540224:0@lo:400:kworker.0 00010000:00080000:3.0:1787892989.644013:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff907137d3fb80 x1874741455540736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893005 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892989.644023:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455540736:0@lo:400:kworker.0 00000100:00100000:3.0:1787892989.644034:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874741455540352:0@lo:400:kworker.0 00010000:00010000:1.0:1787892990.028043:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787892990.158173:0:8104:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 317925417519ns, next at 318925415171ns, rc = 0 00000100:00100000:2.0:1787892990.158546:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787892990.158572:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137e49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455540864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787892990.158645:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892990.158785:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455540864 00000100:00100000:3.0:1787892990.158793:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455540864 00000100:00100000:3.0:1787892990.158851:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787892990.158860:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e5c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455540864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787892990.158882:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787892990.158936:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e5c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455540864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892990.158943:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1787892990.159085:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff907137e49f80 x1874741455540864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893006 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892990.159105:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137e49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455540864:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787892991.053484:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892992.080940:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787892992.562167:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787892992.562308:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431391232 00000100:00100000:0.0:1787892992.562326:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431391232 00000100:00100000:0.0:1787892992.562438:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 101 00000100:00100000:0.0:1787892992.562454:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137e4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+14:2360:x1874741431391232:12345-192.168.202.29@tcp:400:kworker.0 00000100:00080000:3.0:1787892992.562489:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787892992.562590:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137e4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+14:2360:x1874741431391232:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 141us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892992.562600:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 101 00000100:00100000:1.0:1787892992.566675:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787892992.566724:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787892992.566811:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787892992.566938:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431391488 00000100:00100000:2.0:1787892992.566951:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431391488 00000100:00100000:2.0:1787892992.567061:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 102 00000100:00100000:2.0:1787892992.567075:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db96701a-d972-4021-b77b-4d58b82fa12c+5:2360:x1874741431391488:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1787892992.567179:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db96701a-d972-4021-b77b-4d58b82fa12c+5:2360:x1874741431391488:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 107us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892992.567188:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 102 00000100:00080000:1.0:1787892992.567395:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787892992.567581:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431391360 00000100:00100000:0.0:1787892992.567588:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431391360 00000100:00100000:0.0:1787892992.567706:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 56 00000100:00100000:0.0:1787892992.567716:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4829748d-dde1-497a-9623-0e4326f0972c+5:2361:x1874741431391360:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1787892992.567745:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431391104 00000100:00100000:3.0:1787892992.567807:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431391104 00000100:00100000:0.0:1787892992.567828:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4829748d-dde1-497a-9623-0e4326f0972c+5:2361:x1874741431391360:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 113us (1101us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892992.567837:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 56 00000100:00100000:3.0:1787892992.567902:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 248 00000100:00100000:3.0:1787892992.567918:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+13:2361:x1874741431391104:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1787892992.568001:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+13:2361:x1874741431391104:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 88us (1346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892992.568009:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 248 00000100:00080000:1.0:1787892992.569395:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787892993.098213:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787892993.579370:0:11624:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:3.0:1787892993.737252:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455540992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787892993.737331:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892993.737443:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455540992 00000100:00100000:2.0:1787892993.737453:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455540992 00000100:00100000:2.0:1787892993.737520:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787892993.737530:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137e49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455540992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787892993.737822:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787892993.737922:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787892993.743939:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137e49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455540992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6398us (6597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892993.743954:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1787892993.751058:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff907137d3d500 x1874741455540992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893009 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787892993.751089:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455540992:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1787892993.849163:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:0.0:1787892993.849177:0:5870:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1787892993.849212:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:0.0:1787892993.849237:0:5870:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000100:00100000:2.0:1787892993.849834:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455541120:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787892993.849914:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892993.850037:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455541120 00000100:00100000:1.0:1787892993.850048:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455541120 00000100:00100000:1.0:1787892993.850121:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787892993.850131:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e5c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455541120:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787892993.850157:0:6701:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1787892993.850193:0:6701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9114fc, atime: 0x6a9114fc, ctime: 0x6a9114fc, blocks: 0x1 00010000:00010000:1.0:1787892993.850209:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f01a69c/0x825e3f5022b4a8cf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892993.850237:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=321s v=(0 0) 00010000:00010000:1.0:1787892993.850242:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787892993.850249:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f01a69c/0x825e3f5022b4a8cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892993.850269:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f01a69c/0x825e3f5022b4a8cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892993.850281:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f01a69c/0x825e3f5022b4a8cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892993.850289:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f01a69c/0x825e3f5022b4a8cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892993.850315:0:6701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787892993.850327:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787892993.850338:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f01a69c/0x825e3f5022b4a8cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892993.850350:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fa000 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:3.0:1787892993.850356:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f01a69c/0x825e3f5022b4a8cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892993.850368:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f01a69c/0x825e3f5022b4a8cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892993.850394:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f01a69c/0x825e3f5022b4a8cf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892993.850402:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f01a69c/0x825e3f5022b4a8cf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892993.850424:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787892993.850426:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787892993.850428:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787892993.850939:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e5c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1874741455541120:12345-0@lo:6:osp-syn-1-0.0 Request processed in 808us (1024us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787892993.850948:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:1.0:1787892993.850997:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff907137d11f80/2, rc 0, transno 4294967300 00000100:00100000:1.0:1787892993.851003:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455541120:0@lo:6:osp-syn-1-0.0 00000100:00080000:2.0:1787892993.851350:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787892994.122280:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787892994.552062:0:11675:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcb10204e0 20000000:00000080:1.0:1787892994.552078:0:11675:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90713f72e400 uarg=0000000000000000 20000000:01000000:1.0:1787892994.552106:0:11675:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1787892994.552115:0:11675:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1787892994.552119:0:11675:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1787892994.554136:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1787892994.554255:0:11675:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1787892994.556521:0:11675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1787892994.556558:0:11675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1787892994.556588:0:11675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1787892994.556608:0:11675:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787892994.556624:0:11675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907104f47000/0x825e3f5022b4a8d6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892994.556640:0:11675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907103f06400/0x825e3f5022b4a771 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae68 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892994.556646:0:11675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907104f46200/0x825e3f5022b4a778 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae6f expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892994.556651:0:11675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907103f07a00/0x825e3f5022b4a786 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a77f expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892994.556655:0:11675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907103f07600/0x825e3f5022b4a794 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a78d expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892994.556659:0:11675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907103f07200/0x825e3f5022b4a7a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a79b expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892994.556663:0:11675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907104f47000/0x825e3f5022b4a8d6 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892994.556697:0:11675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907103f07200/0x825e3f5022b4a7a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x825e3f5022b4a79b expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892994.556709:0:11675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907103f07200/0x825e3f5022b4a7a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x825e3f5022b4a79b expref: 18 pid: 5841 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892994.556720:0:11675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d10a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1874741455541248:0@lo:104: 00000100:00100000:3.0:1787892994.556836:0:11675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787892994.556887:0:11675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907103f07600/0x825e3f5022b4a794 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x825e3f5022b4a78d expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892994.556898:0:11675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907103f07600/0x825e3f5022b4a794 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x825e3f5022b4a78d expref: 18 pid: 5841 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892994.556904:0:11675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d12d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1874741455541376:0@lo:104: 00000100:00100000:3.0:1787892994.556920:0:11675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787892994.556935:0:11675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907103f07a00/0x825e3f5022b4a786 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x825e3f5022b4a77f expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892994.556940:0:11675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff907103f07a00/0x825e3f5022b4a786 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x825e3f5022b4a77f expref: 18 pid: 5843 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892994.556945:0:11675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d10000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1874741455541504:0@lo:104: 00000100:00100000:3.0:1787892994.556957:0:11675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787892994.556968:0:11675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907104f46200/0x825e3f5022b4a778 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae6f expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892994.556977:0:11675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff907104f46200/0x825e3f5022b4a778 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae6f expref: 12 pid: 5843 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892994.556986:0:11675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d13480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1874741455541632:192.168.202.29@tcp:104: 00010000:00010000:3.0:1787892994.557035:0:11675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907103f06400/0x825e3f5022b4a771 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae68 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892994.557041:0:11675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff907103f06400/0x825e3f5022b4a771 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae68 expref: 12 pid: 5843 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892994.557046:0:11675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d13b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1874741455541760:192.168.202.29@tcp:104: 00000100:00100000:3.0:1787892994.557061:0:11675:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710821f000 going to sleep for 11 seconds 00000100:00100000:1.0:1787892994.557261:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787892994.557272:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455541248 00000100:00100000:1.0:1787892994.557279:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455541248 00000100:00100000:1.0:1787892994.557320:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455541376 00000100:00100000:1.0:1787892994.557322:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455541376 00000100:00100000:1.0:1787892994.557327:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455541504 00000100:00100000:1.0:1787892994.557328:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455541504 00000100:00100000:1.0:1787892994.557337:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787892994.557343:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22d910cf-711e-44e0-9acf-212404ada550+5:11675:x1874741455541248:12345-0@lo:104: 00010000:00010000:1.0:1787892994.557357:0:5831:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9071102b9200/0x825e3f5022b4a79b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a7a2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892994.557416:0:5831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787892994.557421:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22d910cf-711e-44e0-9acf-212404ada550+5:11675:x1874741455541248:12345-0@lo:104: Request processed in 79us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892994.557426:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787892994.557440:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787892994.557443:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22d910cf-711e-44e0-9acf-212404ada550+4:11675:x1874741455541376:12345-0@lo:104: 00010000:00010000:1.0:1787892994.557449:0:5831:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff907104f47200/0x825e3f5022b4a78d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a794 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892994.557470:0:5831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787892994.557473:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22d910cf-711e-44e0-9acf-212404ada550+4:11675:x1874741455541376:12345-0@lo:104: Request processed in 31us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892994.557477:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787892994.557483:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787892994.557487:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f73d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22d910cf-711e-44e0-9acf-212404ada550+3:11675:x1874741455541504:12345-0@lo:104: 00010000:00010000:1.0:1787892994.557497:0:5831:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9071421fb600/0x825e3f5022b4a77f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a786 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892994.557517:0:5831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787892994.557520:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f73d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:22d910cf-711e-44e0-9acf-212404ada550+3:11675:x1874741455541504:12345-0@lo:104: Request processed in 33us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892994.557524:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1787892994.557647:0:7644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787892994.557651:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9071102b9200/0x825e3f5022b4a79b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a7a2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892994.557657:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071102b9200 already unused, calling callback (ffffffffc1c05c20) 10000000:00010000:1.0:1787892994.557660:0:7644:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9071102b9200/0x825e3f5022b4a79b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x825e3f5022b4a7a2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892994.557665:0:7644:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9071102b9200/0x825e3f5022b4a79b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x825e3f5022b4a7a2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787892994.557670:0:7644:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9071102b9200/0x825e3f5022b4a79b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x825e3f5022b4a7a2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787892994.557673:0:7644:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787892994.557693:0:7644:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9071102b9200/0x825e3f5022b4a79b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a7a2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892994.557697:0:7644:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787892994.557712:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9071102b9200/0x825e3f5022b4a79b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a7a2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892994.557718:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9071102b9200/0x825e3f5022b4a79b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a7a2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892994.557737:0:7644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787892994.557740:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff907104f47200/0x825e3f5022b4a78d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a794 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892994.557746:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f47200 already unused, calling callback (ffffffffc1c05c20) 10000000:00010000:1.0:1787892994.557749:0:7644:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff907104f47200/0x825e3f5022b4a78d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x825e3f5022b4a794 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892994.557780:0:7644:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff907104f47200/0x825e3f5022b4a78d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x825e3f5022b4a794 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787892994.557786:0:7644:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff907104f47200/0x825e3f5022b4a78d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x825e3f5022b4a794 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787892994.557791:0:7644:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787892994.557813:0:7644:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff907104f47200/0x825e3f5022b4a78d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a794 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892994.557819:0:7644:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787892994.557825:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff907104f47200/0x825e3f5022b4a78d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a794 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892994.557832:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff907104f47200/0x825e3f5022b4a78d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a794 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892994.557841:0:7644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787892994.557844:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9071421fb600/0x825e3f5022b4a77f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4a786 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892994.557857:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fb600 already unused, calling callback (ffffffffc1c05c20) 10000000:00010000:1.0:1787892994.557859:0:7644:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9071421fb600/0x825e3f5022b4a77f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x825e3f5022b4a786 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892994.557863:0:7644:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9071421fb600/0x825e3f5022b4a77f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x825e3f5022b4a786 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787892994.557866:0:7644:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9071421fb600/0x825e3f5022b4a77f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x825e3f5022b4a786 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787892994.557869:0:7644:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787892994.557879:0:7644:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9071421fb600/0x825e3f5022b4a77f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a786 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892994.557883:0:7644:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787892994.557895:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9071421fb600/0x825e3f5022b4a77f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a786 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892994.557899:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9071421fb600/0x825e3f5022b4a77f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4a786 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892994.557910:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892994.557911:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892994.557912:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892994.557917:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787892994.557921:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787892994.557930:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455541888:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787892994.557953:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892994.557971:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787892994.557984:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455542016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787892994.558006:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892994.558033:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22d910cf-711e-44e0-9acf-212404ada550:3307:1874741455542144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787892994.558050:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892994.558072:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455541888 00000100:00100000:1.0:1787892994.558074:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455541888 00010000:00010000:1.0:1787892994.558089:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907103f07200/0x825e3f5022b4a7a2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a79b expref: 19 pid: 5841 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892994.558103:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455542016 00000100:00100000:1.0:1787892994.558104:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455542016 00010000:00010000:1.0:1787892994.558110:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907103f07600/0x825e3f5022b4a794 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a78d expref: 20 pid: 5841 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892994.558115:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455542144 00000100:00100000:1.0:1787892994.558117:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455542144 00010000:00010000:1.0:1787892994.558121:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907103f07a00/0x825e3f5022b4a786 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a77f expref: 21 pid: 5843 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892994.558128:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787892994.558131:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22d910cf-711e-44e0-9acf-212404ada550+21:3305:x1874741455541888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787892994.558138:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787892994.558141:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907103f07200/0x825e3f5022b4a7a2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a79b expref: 21 pid: 5841 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892994.558149:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907103f07200/0x825e3f5022b4a7a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x825e3f5022b4a79b expref: 21 pid: 5841 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892994.558160:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787892994.558177:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22d910cf-711e-44e0-9acf-212404ada550+21:3305:x1874741455541888:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892994.558186:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787892994.558196:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787892994.558199:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22d910cf-711e-44e0-9acf-212404ada550+20:3305:x1874741455542016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787892994.558204:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787892994.558207:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907103f07600/0x825e3f5022b4a794 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a78d expref: 20 pid: 5841 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892994.558212:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907103f07600/0x825e3f5022b4a794 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x825e3f5022b4a78d expref: 20 pid: 5841 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892994.558219:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787892994.558232:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22d910cf-711e-44e0-9acf-212404ada550+20:3305:x1874741455542016:12345-0@lo:103:ldlm_bl.0 Request processed in 32us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892994.558236:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787892994.558242:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787892994.558246:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107f2a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22d910cf-711e-44e0-9acf-212404ada550+19:3307:x1874741455542144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787892994.558250:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787892994.558252:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907103f07a00/0x825e3f5022b4a786 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4a77f expref: 19 pid: 5843 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892994.558257:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907103f07a00/0x825e3f5022b4a786 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x825e3f5022b4a77f expref: 19 pid: 5843 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892994.558263:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787892994.558276:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107f2a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:22d910cf-711e-44e0-9acf-212404ada550+19:3307:x1874741455542144:12345-0@lo:103:ldlm_bl.0 Request processed in 30us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892994.558280:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787892994.558319:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22d910cf-711e-44e0-9acf-212404ada550:3307:1874741455542144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787892994.558342:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455542016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787892994.558348:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455541888:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787892994.561228:0:11675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907103f07200/0x825e3f5022b4a7a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x825e3f5022b4a79b expref: 18 pid: 5841 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892994.561245:0:11675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d10a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1874741455541248:0@lo:104: 00010000:00010000:3.0:1787892994.561257:0:11675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907103f07600/0x825e3f5022b4a794 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x825e3f5022b4a78d expref: 17 pid: 5841 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892994.561262:0:11675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d12d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1874741455541376:0@lo:104: 00010000:00010000:3.0:1787892994.561267:0:11675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907103f07a00/0x825e3f5022b4a786 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x825e3f5022b4a77f expref: 16 pid: 5843 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892994.561272:0:11675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d10000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1874741455541504:0@lo:104: 00000100:00100000:3.0:1787892994.561522:0:11675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d13480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1874741455541632:192.168.202.29@tcp:104: 00000100:00100000:3.0:1787892994.561527:0:11675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d13b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1874741455541760:192.168.202.29@tcp:104: 00010000:00010000:3.0:1787892994.561550:0:11675:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907104f47000/0x825e3f5022b4a8d6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892994.562340:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892994.562403:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787892994.562521:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431391744 00000100:00100000:1.0:1787892994.562529:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431391744 00010000:00010000:1.0:1787892994.562561:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907103f06400/0x825e3f5022b4a771 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae68 expref: 13 pid: 5843 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892994.562592:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431391616 00000100:00100000:0.0:1787892994.562595:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431391616 00010000:00010000:0.0:1787892994.562606:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907104f46200/0x825e3f5022b4a778 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae6f expref: 14 pid: 5843 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892994.562636:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 33 00000100:00100000:0.0:1787892994.562646:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:18703558-96be-475d-879f-15397926f758+14:2360:x1874741431391744:12345-192.168.202.29@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787892994.562653:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 34 00000100:00100000:2.0:1787892994.562661:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:18703558-96be-475d-879f-15397926f758+14:2360:x1874741431391616:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787892994.562661:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787892994.562666:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907103f06400/0x825e3f5022b4a771 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae68 expref: 14 pid: 5843 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892994.562668:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787892994.562673:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907104f46200/0x825e3f5022b4a778 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae6f expref: 14 pid: 5843 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892994.562677:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907103f06400/0x825e3f5022b4a771 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae68 expref: 14 pid: 5843 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892994.562688:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907104f46200/0x825e3f5022b4a778 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae6f expref: 14 pid: 5843 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892994.562896:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907103f06400/0x825e3f5022b4a771 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae68 expref: 14 pid: 5843 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892994.562897:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907104f46200/0x825e3f5022b4a778 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae6f expref: 14 pid: 5843 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892994.562916:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff907104f47000/0x825e3f5022b4a8d6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892994.562924:0:8463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907104f47000/0x825e3f5022b4a8d6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892994.562932:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787892994.562939:0:8463:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907104f47000/0x825e3f5022b4a8d6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892994.562945:0:8463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907104f47000/0x825e3f5022b4a8d6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892994.562952:0:8463:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907104f47000/0x825e3f5022b4a8d6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892994.562986:0:8463:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907104f47000/0x825e3f5022b4a8d6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892994.562993:0:8463:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f47000 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:2.0:1787892994.562997:0:8463:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907104f47000/0x825e3f5022b4a8d6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892994.563006:0:8463:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907104f47000/0x825e3f5022b4a8d6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892994.563014:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:18703558-96be-475d-879f-15397926f758+12:2360:x1874741431391744:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 370us (676us total) trans 0 rc 0/0 00010000:00010000:2.0:1787892994.563024:0:8463:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907104f47000/0x825e3f5022b4a8d6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787892994.563029:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 33 00010000:00010000:2.0:1787892994.563034:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787892994.563054:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:18703558-96be-475d-879f-15397926f758+11:2360:x1874741431391616:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 394us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892994.563061:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 34 00010000:00010000:3.0:1787892994.563085:0:11675:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907104f47000/0x825e3f5022b4a8d6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892994.563093:0:11675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907104f47000/0x825e3f5022b4a8d6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892994.563098:0:11675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907104f47000/0x825e3f5022b4a8d6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787892994.761275:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f4be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874741455542272:0@lo:400:kworker.0 00000100:00100000:1.0:1787892994.761661:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892994.761707:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907105afb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455542784:0@lo:400:kworker.0 00000100:00100000:1.0:1787892994.761731:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892994.761804:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787892994.761812:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907105afbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874741455542656:0@lo:400:kworker.0 00000100:00100000:1.0:1787892994.761836:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892994.761864:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455542784 00000100:00100000:1.0:1787892994.761868:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f4bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874741455542400:0@lo:400:kworker.0 00000100:00100000:2.0:1787892994.761872:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455542784 00000100:00100000:1.0:1787892994.761890:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892994.761955:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787892994.761966:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1874741455542784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787892994.762035:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1874741455542784:12345-0@lo:400:kworker.0 Request processed in 71us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892994.762042:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787892994.762064:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455542272 00000100:00100000:2.0:1787892994.762068:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455542272 00000100:00100000:2.0:1787892994.762093:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455542656 00000100:00100000:2.0:1787892994.762096:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455542656 00000100:00100000:2.0:1787892994.762132:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455542400 00000100:00100000:2.0:1787892994.762134:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455542400 00000100:00100000:2.0:1787892994.762148:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787892994.762154:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874741455542272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787892994.762186:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874741455542272:12345-0@lo:400:kworker.0 Request processed in 32us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892994.762192:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787892994.762213:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787892994.762221:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874741455542656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787892994.762247:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874741455542656:12345-0@lo:400:kworker.0 Request processed in 27us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892994.762252:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787892994.762263:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787892994.762269:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874741455542400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787892994.762292:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874741455542400:12345-0@lo:400:kworker.0 Request processed in 24us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892994.762298:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:2.0:1787892994.762319:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787892994.762592:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f4bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874741455542400:0@lo:400:kworker.0 00000100:00100000:1.0:1787892994.762606:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787892994.762610:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f4bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455542528:0@lo:400:kworker.0 00000100:00100000:1.0:1787892994.762629:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892994.762830:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907105afbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874741455542656:0@lo:400:kworker.0 00000100:00100000:1.0:1787892994.762844:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f4be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874741455542272:0@lo:400:kworker.0 00000100:00100000:1.0:1787892994.762854:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907105afb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455542784:0@lo:400:kworker.0 00000100:00100000:3.0:1787892994.763307:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455542528 00000100:00100000:3.0:1787892994.763318:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455542528 00000100:00100000:3.0:1787892994.763386:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787892994.763395:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455542528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787892994.763446:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455542528:12345-0@lo:400:kworker.0 Request processed in 52us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892994.763452:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:2.0:1787892994.763476:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90713f4bdc00 x1874741455542528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787892994.763487:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f4bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455542528:0@lo:400:kworker.0 00010000:00010000:1.0:1787892995.147888:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787892995.272995:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455542912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787892995.273080:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892995.273386:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455542912 00000100:00100000:3.0:1787892995.273396:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455542912 00000100:00080000:2.0:1787892995.273461:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787892995.273471:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787892995.273482:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e5c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874741455542912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787892995.273517:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787892995.273615:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e5c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874741455542912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892995.273624:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787892995.277951:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455542912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787892995.960875:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787892995.961031:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431391872 00000100:00100000:0.0:1787892995.961042:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431391872 00000100:00100000:0.0:1787892995.961104:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 249 00000100:00100000:0.0:1787892995.961116:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907113ea9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+11:5604:x1874741431391872:12345-192.168.202.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787892995.961135:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787892995.961155:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907137fc8c00/0x825e3f5022b4a8dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821aebc expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892995.961186:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907137fc8c00/0x825e3f5022b4a8dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aebc expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892995.961199:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907137fc8c00/0x825e3f5022b4a8dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aebc expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892995.961210:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907137fc8c00, rc 0) 00000100:00100000:0.0:1787892995.961275:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907113ea9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+12:5604:x1874741431391872:12345-192.168.202.29@tcp:101:ll_cfg_requeue.0 Request processed in 161us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892995.961293:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 249 00000100:00100000:1.0:1787892995.972130:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892995.975956:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431392000 00000100:00100000:3.0:1787892995.975973:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431392000 00000100:00100000:3.0:1787892995.976049:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 250 00000100:00100000:3.0:1787892995.976061:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907119795450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+12:5604:x1874741431392000:12345-192.168.202.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787892995.976718:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907119795450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+12:5604:x1874741431392000:12345-192.168.202.29@tcp:501:ll_cfg_requeue.0 Request processed in 656us (5048us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892995.976728:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 250 00000100:00100000:3.0:1787892995.982409:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787892995.982526:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431392128 00000100:00100000:2.0:1787892995.982536:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431392128 00000100:00100000:2.0:1787892995.982620:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 251 00000100:00100000:2.0:1787892995.982629:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907119795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+12:5604:x1874741431392128:12345-192.168.202.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787892995.982918:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907119795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+12:5604:x1874741431392128:12345-192.168.202.29@tcp:503:ll_cfg_requeue.0 Request processed in 287us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892995.982925:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 251 00000100:00100000:1.0:1787892995.987556:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787892995.988500:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431392256 00000100:00100000:0.0:1787892995.988512:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431392256 00000100:00100000:0.0:1787892995.988582:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 252 00000100:00100000:0.0:1787892995.988594:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907119794050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+12:9959:x1874741431392256:12345-192.168.202.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787892995.988891:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907119794050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+12:9959:x1874741431392256:12345-192.168.202.29@tcp:502:llog_process_th.0 Request processed in 298us (1343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892995.988899:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 252 00000100:00100000:1.0:1787892996.000597:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892996.000813:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431392384 00000100:00100000:3.0:1787892996.000824:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431392384 00000100:00100000:2.0:1787892996.000982:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 253 00000100:00100000:2.0:1787892996.000993:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907106340050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+12:9959:x1874741431392384:12345-192.168.202.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787892996.001258:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907106340050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+12:9959:x1874741431392384:12345-192.168.202.29@tcp:502:llog_process_th.0 Request processed in 266us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892996.001266:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 253 00000100:00100000:3.0:1787892996.011087:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787892996.011217:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431392512 00000100:00100000:0.0:1787892996.011228:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431392512 00000100:00100000:0.0:1787892996.011286:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 254 00000100:00100000:0.0:1787892996.011306:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907106341c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+12:5604:x1874741431392512:12345-192.168.202.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787892996.011324:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787892996.011342:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907137fc8a00/0x825e3f5022b4a8e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821aec3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892996.011371:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907137fc8a00/0x825e3f5022b4a8e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aec3 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892996.011382:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907137fc8a00/0x825e3f5022b4a8e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aec3 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892996.011391:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907137fc8a00, rc 0) 00000100:00100000:0.0:1787892996.011459:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907106341c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+13:5604:x1874741431392512:12345-192.168.202.29@tcp:101:ll_cfg_requeue.0 Request processed in 163us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892996.011466:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 254 00000100:00100000:1.0:1787892996.018370:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787892996.019288:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431392640 00000100:00100000:2.0:1787892996.019298:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431392640 00000100:00100000:2.0:1787892996.019351:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 255 00000100:00100000:2.0:1787892996.019359:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907106342050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+13:5604:x1874741431392640:12345-192.168.202.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787892996.020076:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907106342050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+13:5604:x1874741431392640:12345-192.168.202.29@tcp:501:ll_cfg_requeue.0 Request processed in 714us (1712us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892996.020087:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 255 00000100:00100000:1.0:1787892996.026446:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787892996.026541:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431392768 00000100:00100000:0.0:1787892996.026552:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431392768 00000100:00100000:0.0:1787892996.026610:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 256 00000100:00100000:0.0:1787892996.026621:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+13:5604:x1874741431392768:12345-192.168.202.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787892996.028570:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+13:5604:x1874741431392768:12345-192.168.202.29@tcp:503:ll_cfg_requeue.0 Request processed in 1941us (2123us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892996.028583:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 256 00000100:00100000:3.0:1787892996.040541:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787892996.040654:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431392896 00000100:00100000:2.0:1787892996.040664:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431392896 00000100:00100000:2.0:1787892996.040728:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 257 00000100:00100000:2.0:1787892996.040739:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+13:9962:x1874741431392896:12345-192.168.202.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787892996.041268:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+13:9962:x1874741431392896:12345-192.168.202.29@tcp:502:llog_process_th.0 Request processed in 529us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892996.041400:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 257 00000100:00100000:1.0:1787892996.049689:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787892996.050291:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431393024 00000100:00100000:0.0:1787892996.050300:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431393024 00000100:00100000:0.0:1787892996.050362:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 258 00000100:00100000:0.0:1787892996.050370:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+13:9962:x1874741431393024:12345-192.168.202.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787892996.050597:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+13:9962:x1874741431393024:12345-192.168.202.29@tcp:502:llog_process_th.0 Request processed in 226us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892996.050606:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 258 00010000:00010000:1.0:1787892996.169131:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787892996.298936:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787892996.298945:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9071072cc000 from 7 10000000:01000000:2.0:1787892996.298951:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787892996.299235:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9071102b8200/0x825e3f5022b4a8eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892996.299246:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9071102b8200/0x825e3f5022b4a8eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787892996.299259:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9071102b8200/0x825e3f5022b4a8eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787892996.299284:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e5c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455543040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787892996.299358:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892996.299433:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff907105efa480 going to sleep for 11 seconds 00000100:00100000:0.0:1787892996.299588:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455543040 00000100:00100000:0.0:1787892996.299596:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455543040 00000100:00100000:0.0:1787892996.299654:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787892996.299664:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+16:5846:x1874741455543040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787892996.299678:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787892996.299690:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907137fc8e00/0x825e3f5022b4a8f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4a8eb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892996.299712:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907137fc8e00/0x825e3f5022b4a8f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4a8eb expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892996.299722:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907137fc8e00/0x825e3f5022b4a8f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a8eb expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787892996.299730:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907137fc8e00, rc 0) 00000100:00100000:0.0:1787892996.299822:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+17:5846:x1874741455543040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892996.299829:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1787892996.300454:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e5c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455543040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787892996.300488:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9071102b8200/0x825e3f5022b4a8eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a8f2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892996.300497:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9071102b8200/0x825e3f5022b4a8eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a8f2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892996.300556:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d12d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455543168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787892996.300590:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892996.300623:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710821fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787892996.300676:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455543168 00000100:00100000:2.0:1787892996.300681:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455543168 00000100:00100000:2.0:1787892996.300775:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1787892996.300791:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+17:5846:x1874741455543168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787892996.301088:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+17:5846:x1874741455543168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 297us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892996.301095:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787892996.301161:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d12d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455543168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787892996.301427:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d12d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455543296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787892996.301468:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892996.306162:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710821fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787892996.312093:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455543296 00000100:00100000:0.0:1787892996.312109:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455543296 00000100:00100000:0.0:1787892996.312176:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1787892996.312184:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+17:5846:x1874741455543296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787892996.313003:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+17:5846:x1874741455543296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 815us (11530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892996.313012:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1787892996.318639:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d12d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455543296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787892996.326456:0:11688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907105afa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:11688:1874741455543424:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787892996.326557:0:11688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892996.326671:0:11688:0:(client.c:2715:ptlrpc_set_wait()) set ffff907107c0bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787892996.331077:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455543424 00000100:00100000:2.0:1787892996.331094:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455543424 00000100:00100000:2.0:1787892996.331160:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787892996.331173:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+17:11688:x1874741455543424:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787892996.331475:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+17:11688:x1874741455543424:12345-0@lo:502:llog_process_th.0 Request processed in 302us (4915us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892996.331483:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1787892996.331815:0:11688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907105afa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:11688:1874741455543424:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787892996.331852:0:11688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787892996.331862:0:11688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787892996.331865:0:11688:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787892996.331872:0:11688:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9071072cc000 00000020:00000080:1.0:1787892996.331874:0:11688:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787892996.331965:0:11688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d3f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:11688:1874741455543552:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787892996.332011:0:11688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892996.332066:0:11688:0:(client.c:2715:ptlrpc_set_wait()) set ffff90712c48d600 going to sleep for 11 seconds 00000100:00100000:3.0:1787892996.332682:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455543552 00000100:00100000:3.0:1787892996.332690:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455543552 00000100:00100000:3.0:1787892996.332743:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1787892996.332788:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+17:11688:x1874741455543552:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787892996.333009:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+17:11688:x1874741455543552:12345-0@lo:502:llog_process_th.0 Request processed in 257us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892996.333017:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787892996.333649:0:11688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d3f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:11688:1874741455543552:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787892996.333681:0:11688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787892996.333689:0:11688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787892996.333691:0:11688:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787892996.333696:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787892996.339798:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1787892996.339840:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787892996.339854:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9071102b8200/0x825e3f5022b4a8eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a8f2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892996.339884:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9071102b8200/0x825e3f5022b4a8eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a8f2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787892996.339895:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787892996.339898:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff907105af0000 from 7 10000000:01000000:3.0:1787892996.339901:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787892996.339949:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff907104f47000/0x825e3f5022b4a8f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892996.339967:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff907104f47000/0x825e3f5022b4a8f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892996.339978:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff907104f47000/0x825e3f5022b4a8f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892996.340005:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d12d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455543680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787892996.340089:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892996.340137:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710821f540 going to sleep for 11 seconds 00000100:00100000:1.0:1787892996.340618:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455543680 00000100:00100000:1.0:1787892996.340627:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455543680 00000100:00100000:1.0:1787892996.340686:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787892996.340705:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+17:5846:x1874741455543680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787892996.340720:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787892996.340734:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9071421fa600/0x825e3f5022b4a900 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4a8f9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892996.340792:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9071421fa600/0x825e3f5022b4a900 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4a8f9 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892996.340812:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9071421fa600/0x825e3f5022b4a900 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a8f9 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787892996.340821:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071421fa600, rc 0) 00000100:00100000:1.0:1787892996.340882:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+18:5846:x1874741455543680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892996.340889:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1787892996.344445:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d12d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455543680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787892996.344478:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff907104f47000/0x825e3f5022b4a8f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a900 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892996.344493:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff907104f47000/0x825e3f5022b4a8f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a900 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892996.344584:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d12d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455543808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787892996.344647:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892996.344718:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710821f540 going to sleep for 11 seconds 00000100:00100000:1.0:1787892996.344820:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455543808 00000100:00100000:1.0:1787892996.344828:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455543808 00000100:00100000:1.0:1787892996.344872:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1787892996.344881:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+18:5846:x1874741455543808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787892996.345501:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+18:5846:x1874741455543808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 617us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892996.345510:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787892996.345586:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d12d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455543808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787892996.345619:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907105afb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455543936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787892996.345668:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787892996.345701:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff90711217bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787892996.346078:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455543936 00000100:00100000:3.0:1787892996.346083:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455543936 00000100:00100000:3.0:1787892996.346120:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1787892996.346128:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+18:5846:x1874741455543936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787892996.346297:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+18:5846:x1874741455543936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 169us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892996.346305:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1787892996.346346:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907105afb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455543936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787892996.346524:0:11690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d10a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:11690:1874741455544064:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787892996.346559:0:11690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892996.346579:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455544064 00000100:00100000:3.0:1787892996.346583:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455544064 00000100:00100000:3.0:1787892996.346601:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787892996.346607:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+18:11690:x1874741455544064:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787892996.346724:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+18:11690:x1874741455544064:12345-0@lo:502:llog_process_th.0 Request processed in 117us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892996.346731:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787892996.346798:0:11690:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710821f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787892996.346822:0:11690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d10a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:11690:1874741455544064:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787892996.346843:0:11690:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787892996.346852:0:11690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787892996.346854:0:11690:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787892996.346860:0:11690:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff907105af0000 00000020:00000080:3.0:1787892996.346862:0:11690:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787892996.346947:0:11690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d10a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:11690:1874741455544192:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787892996.346996:0:11690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892996.347013:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455544192 00000100:00100000:3.0:1787892996.347016:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455544192 00000100:00100000:3.0:1787892996.347032:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787892996.347038:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+18:11690:x1874741455544192:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787892996.347138:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+18:11690:x1874741455544192:12345-0@lo:502:llog_process_th.0 Request processed in 100us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892996.347145:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787892996.347172:0:11690:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710821f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787892996.347183:0:11690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d10a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:11690:1874741455544192:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787892996.347199:0:11690:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787892996.347204:0:11690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787892996.347206:0:11690:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787892996.347209:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787892996.347256:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1787892996.347269:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787892996.347277:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff907104f47000/0x825e3f5022b4a8f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a900 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892996.347287:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff907104f47000/0x825e3f5022b4a8f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a900 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787892996.347297:0:5846:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787892996.347300:0:5846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90710510c800 from 7 10000000:01000000:3.0:1787892996.347302:0:5846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787892996.347324:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff907104f46400/0x825e3f5022b4a907 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892996.347332:0:5846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff907104f46400/0x825e3f5022b4a907 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892996.347348:0:5846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff907104f46400/0x825e3f5022b4a907 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892996.347361:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d10a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455544320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787892996.347386:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892996.347399:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710821f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787892996.347411:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455544320 00000100:00100000:3.0:1787892996.347414:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455544320 00000100:00100000:3.0:1787892996.347432:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787892996.347437:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+18:5846:x1874741455544320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787892996.347445:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787892996.347457:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907104f47a00/0x825e3f5022b4a90e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4a907 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892996.347477:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907104f47a00/0x825e3f5022b4a90e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4a907 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892996.347486:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907104f47a00/0x825e3f5022b4a90e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4a907 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892996.347494:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907104f47a00, rc 0) 00000100:00100000:3.0:1787892996.347521:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+19:5846:x1874741455544320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 82us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892996.347526:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787892996.347553:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d10a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455544320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787892996.347564:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff907104f46400/0x825e3f5022b4a907 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a90e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892996.347580:0:5846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff907104f46400/0x825e3f5022b4a907 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a90e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787892996.347617:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d10a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455544448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787892996.347641:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892996.347654:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710821f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787892996.347665:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455544448 00000100:00100000:3.0:1787892996.347667:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455544448 00000100:00100000:3.0:1787892996.347685:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787892996.347690:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+19:5846:x1874741455544448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787892996.347904:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+19:5846:x1874741455544448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 213us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892996.347910:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787892996.347940:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d10a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455544448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787892996.347962:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d10a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455544576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787892996.347994:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892996.348008:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710821f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787892996.348019:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455544576 00000100:00100000:3.0:1787892996.348022:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455544576 00000100:00100000:3.0:1787892996.348039:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1787892996.348045:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+19:5846:x1874741455544576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787892996.348144:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+19:5846:x1874741455544576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892996.348151:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1787892996.348190:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d10a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:22d910cf-711e-44e0-9acf-212404ada550:5846:1874741455544576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787892996.348421:0:11691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d10a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:11691:1874741455544704:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787892996.348451:0:11691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892996.348470:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455544704 00000100:00100000:3.0:1787892996.348473:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455544704 00000100:00100000:3.0:1787892996.348492:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1787892996.348498:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+19:11691:x1874741455544704:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787892996.348613:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+19:11691:x1874741455544704:12345-0@lo:502:llog_process_th.0 Request processed in 114us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892996.348619:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1787892996.348646:0:11691:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710821f240 going to sleep for 11 seconds 00000100:00100000:3.0:1787892996.348658:0:11691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d10a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:11691:1874741455544704:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787892996.348678:0:11691:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787892996.348685:0:11691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787892996.348687:0:11691:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787892996.348692:0:11691:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90710510c800 00000020:00000080:3.0:1787892996.348694:0:11691:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787892996.348742:0:11691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d10a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:11691:1874741455544832:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787892996.348806:0:11691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892996.348824:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455544832 00000100:00100000:3.0:1787892996.348827:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455544832 00000100:00100000:3.0:1787892996.348843:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1787892996.348849:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+19:11691:x1874741455544832:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787892996.348939:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+19:11691:x1874741455544832:12345-0@lo:502:llog_process_th.0 Request processed in 90us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892996.348946:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1787892996.348972:0:11691:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710828db40 going to sleep for 11 seconds 00000100:00100000:3.0:1787892996.348982:0:11691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d10a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:22d910cf-711e-44e0-9acf-212404ada550:11691:1874741455544832:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787892996.348996:0:11691:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787892996.348999:0:11691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787892996.349001:0:11691:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787892996.349004:0:11691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787892996.349034:0:5846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1787892996.349044:0:5846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787892996.349051:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff907104f46400/0x825e3f5022b4a907 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a90e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787892996.349060:0:5846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff907104f46400/0x825e3f5022b4a907 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a90e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787892996.387892:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787892997.194829:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787892997.452233:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787892997.684223:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787892997.684275:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892997.684294:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431393152 00000100:00100000:3.0:1787892997.684305:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431393152 00000100:00100000:1.0:1787892997.684315:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787892997.684356:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787892997.684370:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 274 00000100:00100000:3.0:1787892997.684384:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+13:2363:x1874741431393152:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1787892997.684428:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431393408 00000100:00100000:2.0:1787892997.684434:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431393408 00000100:00100000:3.0:1787892997.684475:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+13:2363:x1874741431393152:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 94us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892997.684486:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 274 00000100:00100000:2.0:1787892997.684489:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 59 00000100:00100000:2.0:1787892997.684500:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4829748d-dde1-497a-9623-0e4326f0972c+5:2363:x1874741431393408:12345-192.168.202.29@tcp:400:kworker.0 00000100:00080000:3.0:1787892997.684532:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787892997.684538:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4829748d-dde1-497a-9623-0e4326f0972c+5:2363:x1874741431393408:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 39us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892997.684546:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 59 00000100:00100000:0.0:1787892997.685449:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431393280 00000100:00100000:0.0:1787892997.685459:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431393280 00000100:00080000:3.0:1787892997.685513:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787892997.685516:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431393536 00000100:00100000:0.0:1787892997.685521:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431393536 00000100:00080000:3.0:1787892997.685546:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787892997.685560:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 106 00000100:00100000:0.0:1787892997.685641:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+5:2363:x1874741431393280:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1787892997.685674:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 107 00000100:00100000:3.0:1787892997.685683:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db96701a-d972-4021-b77b-4d58b82fa12c+5:2363:x1874741431393536:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1787892997.685743:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db96701a-d972-4021-b77b-4d58b82fa12c+5:2363:x1874741431393536:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 62us (1386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892997.685792:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 107 00000100:00100000:0.0:1787892997.686933:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+5:2363:x1874741431393280:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 1289us (2611us total) trans 0 rc 0/0 00000100:00100000:0.0:1787892997.686944:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 106 00010000:00010000:1.0:1787892998.217012:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787892998.859814:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787892998.859840:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455544960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787892998.859915:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787892998.859985:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455544960 00000100:00100000:2.0:1787892998.859995:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455544960 00000100:00100000:2.0:1787892998.860135:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787892998.860148:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455544960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787892998.860194:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787892998.860272:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455544960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787892998.860281:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1787892998.860457:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff907137d3c000 x1874741455544960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893014 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892998.860477:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455544960:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787892998.863002:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1787892998.934235:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:1.0:1787892999.241598:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787892999.881340:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455545472:0@lo:400:kworker.0 00000100:00100000:3.0:1787892999.881417:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892999.881504:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787892999.881511:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874741455545344:0@lo:400:kworker.0 00000100:00100000:3.0:1787892999.881538:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892999.881577:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455545472 00000100:00100000:3.0:1787892999.881585:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455545472 00000100:00100000:3.0:1787892999.881634:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787892999.881643:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455545472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787892999.881693:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455545472:12345-0@lo:400:kworker.0 Request processed in 51us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892999.881698:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787892999.881728:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455545344 00000100:00100000:3.0:1787892999.881731:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455545344 00000100:00100000:3.0:1787892999.881794:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787892999.881802:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874741455545344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787892999.881834:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874741455545344:12345-0@lo:400:kworker.0 Request processed in 34us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892999.881841:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:3.0:1787892999.881859:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787892999.881876:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22d910cf-711e-44e0-9acf-212404ada550:3307:1874741455545088:0@lo:400:kworker.0 00000100:00100000:3.0:1787892999.881894:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874741455545344:0@lo:400:kworker.0 00010000:00080000:3.0:1787892999.881910:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff907137d12a00 x1874741455545472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893015 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787892999.881921:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892999.881941:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455545472:0@lo:400:kworker.0 00000100:00100000:1.0:1787892999.881960:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874741455545600:0@lo:400:kworker.0 00000100:00100000:3.0:1787892999.881989:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455545088 00000100:00100000:1.0:1787892999.881990:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787892999.881996:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455545088 00000100:00100000:1.0:1787892999.882018:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787892999.882027:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874741455545216:0@lo:400:kworker.0 00000100:00100000:3.0:1787892999.882029:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1787892999.882041:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+19:3307:x1874741455545088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787892999.882057:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892999.882079:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455545728:0@lo:400:kworker.0 00000100:00100000:1.0:1787892999.882102:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787892999.882129:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455545600 00000100:00100000:1.0:1787892999.882133:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455545600 00000100:00100000:1.0:1787892999.882164:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455545216 00000100:00100000:1.0:1787892999.882167:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455545216 00000100:00100000:1.0:1787892999.882188:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787892999.882197:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874741455545600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787892999.882239:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874741455545600:12345-0@lo:400:kworker.0 Request processed in 44us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892999.882246:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787892999.882261:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787892999.882276:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874741455545216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787892999.882315:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874741455545216:12345-0@lo:400:kworker.0 Request processed in 40us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892999.882321:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787892999.882347:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455545728 00000100:00100000:1.0:1787892999.882351:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455545728 00000100:00080000:0.0:1787892999.882366:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787892999.882371:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787892999.882381:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787892999.882391:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455545728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787892999.882407:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874741455545216:0@lo:400:kworker.0 00000100:00100000:0.0:1787892999.882425:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874741455545600:0@lo:400:kworker.0 00000100:00100000:1.0:1787892999.882429:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455545728:12345-0@lo:400:kworker.0 Request processed in 38us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787892999.882438:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787892999.882452:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1787892999.882480:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff907137d11f80, transno 4294967300 00000100:00100000:0.0:1787892999.882497:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455545728:0@lo:400:kworker.0 00000100:00100000:3.0:1787892999.883227:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+19:3307:x1874741455545088:12345-0@lo:400:kworker.0 Request processed in 1184us (1304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787892999.883236:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1787892999.885482:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22d910cf-711e-44e0-9acf-212404ada550:3307:1874741455545088:0@lo:400:kworker.0 00010000:00010000:1.0:1787893000.265361:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893000.393010:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455545856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787893000.393091:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893000.393242:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455545856 00000100:00100000:2.0:1787893000.393252:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455545856 00000100:00100000:2.0:1787893000.393305:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787893000.393315:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455545856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787893000.393357:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787893000.393600:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455545856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 284us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893000.393608:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787893000.393676:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455545856:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787893001.289079:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893002.314513:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893002.802424:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893002.802481:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893002.802532:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893002.802587:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893002.802635:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431393664 00000100:00100000:3.0:1787893002.802650:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431393664 00000100:00100000:2.0:1787893002.802652:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431393792 00000100:00100000:2.0:1787893002.802673:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431393792 00000100:00100000:2.0:1787893002.802850:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431394048 00000100:00100000:2.0:1787893002.802855:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431394048 00000100:00100000:0.0:1787893002.802895:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 111 00000100:00100000:0.0:1787893002.802923:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+5:2360:x1874741431393792:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1787893002.803036:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+5:2360:x1874741431393792:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 121us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893002.803122:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 276 00000100:00100000:3.0:1787893002.803131:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+13:2360:x1874741431393664:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1787893002.803163:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+13:2360:x1874741431393664:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 34us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893002.803173:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 276 00000100:00100000:3.0:1787893002.803224:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431393920 00000100:00100000:3.0:1787893002.803230:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431393920 00000100:00100000:3.0:1787893002.803266:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 62 00000100:00100000:3.0:1787893002.803274:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4829748d-dde1-497a-9623-0e4326f0972c+5:2360:x1874741431393920:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1787893002.803307:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4829748d-dde1-497a-9623-0e4326f0972c+5:2360:x1874741431393920:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 34us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893002.803333:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 62 00000100:00080000:1.0:1787893002.803742:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787893002.803749:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787893002.806782:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 112 00000100:00100000:2.0:1787893002.806814:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db96701a-d972-4021-b77b-4d58b82fa12c+5:2360:x1874741431394048:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1787893002.806855:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 111 00000100:00100000:2.0:1787893002.806932:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db96701a-d972-4021-b77b-4d58b82fa12c+5:2360:x1874741431394048:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 133us (4448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893002.806942:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 112 00010000:00010000:1.0:1787893003.338748:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893003.977558:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f4be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455545984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787893003.977670:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893003.977814:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455545984 00000100:00100000:3.0:1787893003.977824:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455545984 00000100:00100000:3.0:1787893003.977892:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1787893003.978039:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787893003.978525:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455545984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787893003.978587:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787893003.978680:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455545984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 777us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893003.978688:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1787893003.978908:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90713f4be300 x1874741455545984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893019 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893003.978933:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f4be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455545984:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787893004.362589:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893005.003104:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e5c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22d910cf-711e-44e0-9acf-212404ada550:3307:1874741455546112:0@lo:400:kworker.0 00000100:00100000:2.0:1787893005.003180:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893005.003279:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700389bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874741455546624:0@lo:400:kworker.0 00000100:00100000:2.0:1787893005.003301:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893005.003321:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787893005.003325:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e5c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874741455546240:0@lo:400:kworker.0 00000100:00100000:2.0:1787893005.003338:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893005.003348:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907003898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455546752:0@lo:400:kworker.0 00000100:00100000:2.0:1787893005.003362:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893005.003382:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907003899500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874741455546368:0@lo:400:kworker.0 00000100:00100000:2.0:1787893005.003395:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893005.003405:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787893005.003408:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907003898e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455546496:0@lo:400:kworker.0 00000100:00100000:2.0:1787893005.003418:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893005.003464:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455546624 00000100:00100000:2.0:1787893005.003471:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455546624 00000100:00100000:0.0:1787893005.003577:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455546112 00000100:00100000:0.0:1787893005.003590:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455546112 00000100:00100000:0.0:1787893005.003657:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1787893005.003816:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455546240 00000100:00100000:3.0:1787893005.003823:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455546240 00000100:00100000:3.0:1787893005.003856:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455546368 00000100:00100000:3.0:1787893005.003860:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455546368 00000100:00100000:0.0:1787893005.003864:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+19:3307:x1874741455546112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893005.003878:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455546752 00000100:00100000:3.0:1787893005.003891:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787893005.003895:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455546752 00000100:00100000:3.0:1787893005.003905:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137f7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874741455546624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893005.003947:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455546496 00000100:00100000:1.0:1787893005.003951:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455546496 00000100:00100000:1.0:1787893005.003989:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787893005.003994:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787893005.003997:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137f7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455546752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893005.004002:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137f7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874741455546240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893005.004058:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+19:3307:x1874741455546112:12345-0@lo:400:kworker.0 Request processed in 201us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893005.004071:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137f7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874741455546624:12345-0@lo:400:kworker.0 Request processed in 161us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893005.004082:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1787893005.004096:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787893005.004122:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787893005.004134:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137f7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874741455546368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893005.004184:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137f7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874741455546368:12345-0@lo:400:kworker.0 Request processed in 54us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893005.004194:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787893005.004194:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e5c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22d910cf-711e-44e0-9acf-212404ada550:3307:1874741455546112:0@lo:400:kworker.0 00000100:00100000:0.0:1787893005.004230:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700389bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874741455546624:0@lo:400:kworker.0 00000100:00100000:3.0:1787893005.004436:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907003899500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874741455546368:0@lo:400:kworker.0 00000100:00100000:1.0:1787893005.004822:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137f7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455546752:12345-0@lo:400:kworker.0 Request processed in 824us (1456us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893005.004831:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787893005.004857:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787893005.004866:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137f7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455546496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893005.004920:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137f7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455546496:12345-0@lo:400:kworker.0 Request processed in 56us (1499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893005.004927:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1787893005.004947:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787893005.004952:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787893005.004955:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787893005.005001:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff907003898e00 x1874741455546496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893005.005016:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907003898e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455546496:0@lo:400:kworker.0 00000100:00100000:0.0:1787893005.005930:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907003898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455546752:0@lo:400:kworker.0 00000100:00100000:2.0:1787893005.007293:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137f7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874741455546240:12345-0@lo:400:kworker.0 Request processed in 3285us (3946us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893005.007315:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787893005.007804:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e5c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874741455546240:0@lo:400:kworker.0 00010000:00010000:1.0:1787893005.387098:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893005.515513:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455546880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787893005.515593:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893005.515741:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455546880 00000100:00100000:2.0:1787893005.515780:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455546880 00000100:00100000:2.0:1787893005.515837:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787893005.515848:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455546880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787893005.515888:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787893005.518600:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455546880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2743us (2996us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893005.518614:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787893005.519489:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455546880:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787893006.409373:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893007.433007:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787893007.689464:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787893007.923221:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893007.923266:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893007.923316:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893007.923340:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893007.923378:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431394304 00000100:00100000:3.0:1787893007.923391:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431394304 00000100:00100000:3.0:1787893007.923450:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431394560 00000100:00100000:3.0:1787893007.923453:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431394560 00000100:00100000:3.0:1787893007.923476:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 116 00000100:00100000:3.0:1787893007.923486:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+5:2361:x1874741431394304:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1787893007.923593:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+5:2361:x1874741431394304:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 107us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893007.923602:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 116 00000100:00100000:3.0:1787893007.923620:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 117 00000100:00100000:3.0:1787893007.923626:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db96701a-d972-4021-b77b-4d58b82fa12c+5:2361:x1874741431394560:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1787893007.923665:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db96701a-d972-4021-b77b-4d58b82fa12c+5:2361:x1874741431394560:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 39us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893007.923681:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 117 00000100:00100000:2.0:1787893007.923958:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431394432 00000100:00100000:2.0:1787893007.923964:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431394432 00000100:00100000:2.0:1787893007.924009:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 65 00000100:00100000:2.0:1787893007.924017:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4829748d-dde1-497a-9623-0e4326f0972c+5:2361:x1874741431394432:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1787893007.924047:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4829748d-dde1-497a-9623-0e4326f0972c+5:2361:x1874741431394432:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 32us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893007.924053:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 65 00000100:00080000:1.0:1787893007.924211:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787893007.924218:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787893007.925454:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431394176 00000100:00100000:0.0:1787893007.925469:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431394176 00000100:00100000:0.0:1787893007.925525:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 278 00000100:00100000:0.0:1787893007.925668:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+13:2361:x1874741431394176:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1787893007.925789:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+13:2361:x1874741431394176:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 254us (2590us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893007.937428:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 278 00010000:00010000:1.0:1787893008.460350:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893009.097625:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455547008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787893009.097722:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893009.098042:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455547008 00000100:00100000:3.0:1787893009.098052:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455547008 00000100:00100000:3.0:1787893009.098122:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787893009.098132:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f565880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455547008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787893009.098165:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787893009.098213:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f565880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455547008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893009.098233:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:3.0:1787893009.098267:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff907137d11180 x1874741455547008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893025 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893009.098282:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455547008:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787893009.098393:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787893009.482059:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893010.121462:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f565500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874741455547264:0@lo:400:kworker.0 00000100:00100000:1.0:1787893010.121550:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893010.121626:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907113d11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455547776:0@lo:400:kworker.0 00000100:00100000:1.0:1787893010.121662:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893010.121695:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787893010.121701:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f565180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22d910cf-711e-44e0-9acf-212404ada550:3308:1874741455547136:0@lo:400:kworker.0 00000100:00100000:1.0:1787893010.121729:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893010.121748:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f566a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874741455547648:0@lo:400:kworker.0 00000100:00100000:1.0:1787893010.121815:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893010.121842:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f566680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874741455547392:0@lo:400:kworker.0 00000100:00100000:1.0:1787893010.121868:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893010.121885:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787893010.121890:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f566300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455547520:0@lo:400:kworker.0 00000100:00100000:1.0:1787893010.121910:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893010.121940:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455547776 00000100:00100000:1.0:1787893010.121950:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455547776 00000100:00100000:1.0:1787893010.122002:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455547520 00000100:00100000:1.0:1787893010.122005:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455547520 00000100:00100000:1.0:1787893010.122025:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787893010.122034:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455547776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893010.122085:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455547776:12345-0@lo:400:kworker.0 Request processed in 52us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893010.122093:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787893010.122421:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787893010.122430:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f90c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455547520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893010.122474:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f90c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455547520:12345-0@lo:400:kworker.0 Request processed in 46us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893010.122492:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:1.0:1787893010.122527:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90713f566300 x1874741455547520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893010.122541:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f566300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455547520:0@lo:400:kworker.0 00000100:00100000:1.0:1787893010.122569:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907113d11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455547776:0@lo:400:kworker.0 00000100:00100000:2.0:1787893010.122827:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455547264 00000100:00100000:2.0:1787893010.122833:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455547264 00000100:00100000:2.0:1787893010.122875:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455547648 00000100:00100000:2.0:1787893010.122878:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455547648 00000100:00100000:2.0:1787893010.122893:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455547392 00000100:00100000:2.0:1787893010.122896:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455547392 00000100:00100000:2.0:1787893010.122910:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787893010.122924:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874741455547264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893010.122970:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874741455547264:12345-0@lo:400:kworker.0 Request processed in 48us (1421us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893010.122977:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787893010.122991:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787893010.122997:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f90ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874741455547648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893010.123028:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f90ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874741455547648:12345-0@lo:400:kworker.0 Request processed in 31us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893010.123033:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787893010.123045:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787893010.123051:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f90f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874741455547392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893010.123079:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f90f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874741455547392:12345-0@lo:400:kworker.0 Request processed in 29us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893010.123085:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:2.0:1787893010.123290:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787893010.123296:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787893010.123321:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f566a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874741455547648:0@lo:400:kworker.0 00000100:00100000:2.0:1787893010.123348:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f565500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874741455547264:0@lo:400:kworker.0 00000100:00100000:0.0:1787893010.123548:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455547136 00000100:00100000:0.0:1787893010.123553:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455547136 00000100:00100000:0.0:1787893010.123586:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1787893010.123594:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+19:3308:x1874741455547136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893010.123650:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+19:3308:x1874741455547136:12345-0@lo:400:kworker.0 Request processed in 58us (1920us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893010.123666:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1787893010.123745:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f565180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22d910cf-711e-44e0-9acf-212404ada550:3308:1874741455547136:0@lo:400:kworker.0 00000100:00100000:1.0:1787893010.124159:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f566680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874741455547392:0@lo:400:kworker.0 00010000:00010000:1.0:1787893010.507559:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893010.636015:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787893010.636035:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455547904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787893010.636091:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893010.636144:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455547904 00000100:00100000:3.0:1787893010.636153:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455547904 00000100:00100000:3.0:1787893010.636219:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787893010.636229:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105afb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455547904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787893010.636266:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787893010.636485:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105afb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455547904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 257us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893010.636493:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787893010.637190:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455547904:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787893011.529395:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893012.553211:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893013.046447:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893013.046498:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893013.046569:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431394688 00000100:00100000:0.0:1787893013.046580:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431394688 00000100:00100000:0.0:1787893013.046681:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 280 00000100:00100000:0.0:1787893013.046694:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+13:2363:x1874741431394688:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1787893013.047036:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+13:2363:x1874741431394688:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 343us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893013.047045:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 280 00000100:00100000:2.0:1787893013.047790:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431394816 00000100:00100000:2.0:1787893013.047798:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431394816 00000100:00100000:2.0:1787893013.047875:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 121 00000100:00100000:2.0:1787893013.047886:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+5:2363:x1874741431394816:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1787893013.047936:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+5:2363:x1874741431394816:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 53us (1438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893013.047942:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 121 00000100:00080000:3.0:1787893013.049425:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787893013.059045:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893013.059104:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893013.059875:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431395072 00000100:00100000:3.0:1787893013.059888:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431395072 00000100:00100000:3.0:1787893013.059981:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 122 00000100:00100000:3.0:1787893013.059993:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907113d11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db96701a-d972-4021-b77b-4d58b82fa12c+5:2362:x1874741431395072:12345-192.168.202.29@tcp:400:kworker.0 00000100:00080000:2.0:1787893013.060222:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787893013.060434:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907113d11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db96701a-d972-4021-b77b-4d58b82fa12c+5:2362:x1874741431395072:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 442us (1328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893013.060443:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 122 00000100:00100000:1.0:1787893013.060926:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431394944 00000100:00100000:1.0:1787893013.060933:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431394944 00000100:00100000:1.0:1787893013.060995:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 19 00000100:00100000:1.0:1787893013.061004:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907113d11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4829748d-dde1-497a-9623-0e4326f0972c+5:2359:x1874741431394944:12345-192.168.202.29@tcp:9:kworker.0 00000020:00000080:1.0:1787893013.061026:0:6701:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x825e3f5022b4a84a 00000100:00080000:1.0:1787893013.061036:0:6701:0:(import.c:65:import_set_state_nolock()) ffff90713f9c4800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787893013.061159:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1787893013.061410:0:6701:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00080000:2.0:1787893013.063809:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787893013.069154:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907113d11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4829748d-dde1-497a-9623-0e4326f0972c+2:2359:x1874741431394944:12345-192.168.202.29@tcp:9:kworker.0 Request processed in 8138us (10109us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893013.069168:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 19 00010000:00010000:1.0:1787893013.582307:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893014.218785:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787893014.218808:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907105afb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455548032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787893014.218885:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893014.218982:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455548032 00000100:00100000:0.0:1787893014.218992:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455548032 00000100:00100000:0.0:1787893014.219060:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787893014.219070:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105afa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455548032:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787893014.219075:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1787893014.219107:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787893014.219169:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105afa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455548032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893014.219176:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:0.0:1787893014.219217:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff907105afb480 x1874741455548032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893030 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893014.219246:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907105afb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455548032:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1787893014.268545:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4829748d-dde1-497a-9623-0e4326f0972c 00000020:00000080:0.0:1787893014.268554:0:7656:0:(genops.c:885:class_export_put()) final put ffff90713f9c5800/4829748d-dde1-497a-9623-0e4326f0972c 00000020:00000080:2.0:1787893014.268673:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90713f9c5800/4829748d-dde1-497a-9623-0e4326f0972c for lustre-OST0001 00000020:00000080:2.0:1787893014.268727:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90713f9c4800 for lustre-OST0001 00010000:00010000:1.0:1787893014.601126:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893015.243365:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f90ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874741455548416:0@lo:400:kworker.0 00000100:00100000:1.0:1787893015.243440:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893015.243492:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787893015.243499:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f90e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455548544:0@lo:400:kworker.0 00000100:00100000:1.0:1787893015.243526:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893015.243666:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f90fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874741455548288:0@lo:400:kworker.0 00000100:00100000:2.0:1787893015.243710:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893015.243733:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f90d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455548800:0@lo:400:kworker.0 00000100:00100000:2.0:1787893015.243779:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893015.243805:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787893015.243812:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f90f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22d910cf-711e-44e0-9acf-212404ada550:3308:1874741455548160:0@lo:400:kworker.0 00000100:00100000:2.0:1787893015.243842:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893015.243865:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f90ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874741455548672:0@lo:400:kworker.0 00000100:00100000:2.0:1787893015.243886:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893015.243916:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455548416 00000100:00100000:2.0:1787893015.243923:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455548416 00000100:00100000:2.0:1787893015.243973:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455548288 00000100:00100000:2.0:1787893015.243977:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455548288 00000100:00100000:2.0:1787893015.243989:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455548672 00000100:00100000:2.0:1787893015.243991:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455548672 00000100:00100000:2.0:1787893015.244009:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787893015.244018:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f90d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874741455548416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893015.244080:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f90d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874741455548416:12345-0@lo:400:kworker.0 Request processed in 62us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893015.244088:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1787893015.244104:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787893015.244119:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907113d10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874741455548288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893015.244154:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907113d10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874741455548288:12345-0@lo:400:kworker.0 Request processed in 36us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893015.244159:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787893015.244171:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787893015.244177:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907113d13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874741455548672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893015.244204:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907113d13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874741455548672:12345-0@lo:400:kworker.0 Request processed in 27us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893015.244210:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787893015.244230:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455548544 00000100:00100000:2.0:1787893015.244233:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455548544 00000100:00100000:2.0:1787893015.244257:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455548800 00000100:00100000:2.0:1787893015.244260:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455548800 00000100:00100000:2.0:1787893015.244282:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787893015.244288:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f90d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455548544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893015.244319:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f90d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455548544:12345-0@lo:400:kworker.0 Request processed in 31us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893015.244324:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787893015.244336:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787893015.244342:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907113d12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455548800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893015.244372:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907113d12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455548800:12345-0@lo:400:kworker.0 Request processed in 31us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893015.244378:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787893015.244400:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455548160 00000100:00100000:2.0:1787893015.244404:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455548160 00000100:00100000:2.0:1787893015.244429:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1787893015.244436:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+19:3308:x1874741455548160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893015.244477:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+19:3308:x1874741455548160:12345-0@lo:400:kworker.0 Request processed in 41us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893015.244483:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00080000:2.0:1787893015.244508:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787893015.244513:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787893015.244542:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90713f90e680 x1874741455548544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893015.244558:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f90e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455548544:0@lo:400:kworker.0 00000100:00100000:3.0:1787893015.244884:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f90f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22d910cf-711e-44e0-9acf-212404ada550:3308:1874741455548160:0@lo:400:kworker.0 00000100:00100000:3.0:1787893015.244895:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f90ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874741455548672:0@lo:400:kworker.0 00000100:00100000:3.0:1787893015.244920:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f90fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874741455548288:0@lo:400:kworker.0 00000100:00100000:3.0:1787893015.244929:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f90d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455548800:0@lo:400:kworker.0 00000100:00100000:2.0:1787893015.244984:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f90ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874741455548416:0@lo:400:kworker.0 00010000:00010000:0.0:1787893015.625913:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893015.759625:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787893015.759652:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455548928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787893015.759789:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893015.759907:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455548928 00000100:00100000:0.0:1787893015.759915:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455548928 00000100:00100000:0.0:1787893015.759971:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787893015.759983:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455548928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787893015.760022:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787893015.760074:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455548928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893015.760082:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787893015.760129:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455548928:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787893016.659338:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893017.674569:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787893017.929958:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787893018.163611:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893018.163665:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893018.163701:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893018.163814:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431395328 00000100:00100000:0.0:1787893018.163828:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431395328 00000100:00100000:0.0:1787893018.163908:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431395456 00000100:00100000:0.0:1787893018.163912:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431395456 00000100:00100000:0.0:1787893018.163937:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 126 00000100:00100000:0.0:1787893018.163948:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907113d11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+5:2363:x1874741431395328:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1787893018.164034:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907113d11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+5:2363:x1874741431395328:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 89us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893018.164043:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 126 00000100:00100000:0.0:1787893018.164059:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 127 00000100:00100000:0.0:1787893018.164064:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907113d11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db96701a-d972-4021-b77b-4d58b82fa12c+5:2363:x1874741431395456:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1787893018.164088:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907113d11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db96701a-d972-4021-b77b-4d58b82fa12c+5:2363:x1874741431395456:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 24us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893018.164094:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 127 00000100:00080000:2.0:1787893018.164852:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787893018.164969:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431395200 00000100:00100000:3.0:1787893018.164976:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431395200 00000100:00100000:3.0:1787893018.165025:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 282 00000100:00100000:3.0:1787893018.165032:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+13:2363:x1874741431395200:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1787893018.165085:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+13:2363:x1874741431395200:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 53us (1419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893018.165092:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 282 00010000:00010000:0.0:1787893018.696997:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893019.342961:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787893019.342982:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f90c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455549056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787893019.343051:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893019.343115:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455549056 00000100:00100000:1.0:1787893019.343121:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455549056 00000100:00100000:1.0:1787893019.343173:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787893019.343182:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f90e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455549056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787893019.343218:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787893019.343262:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f90e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455549056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893019.343269:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1787893019.343289:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787893019.343315:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90713f90c380 x1874741455549056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893035 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893019.343333:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f90c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455549056:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787893019.725632:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787893019.790149:0:11861:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 00:56:57 (1787893017) 00000100:00100000:2.0:1787893020.361484:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907105afb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874741455549312:0@lo:400:kworker.0 00000100:00100000:2.0:1787893020.361582:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893020.361654:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907003899500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455549824:0@lo:400:kworker.0 00000100:00100000:2.0:1787893020.361679:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893020.361710:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787893020.361716:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907105afb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22d910cf-711e-44e0-9acf-212404ada550:3308:1874741455549184:0@lo:400:kworker.0 00000100:00100000:2.0:1787893020.361744:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893020.361790:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907003898e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874741455549696:0@lo:400:kworker.0 00000100:00100000:2.0:1787893020.361813:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893020.361844:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455549824 00000100:00100000:2.0:1787893020.361865:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455549824 00000100:00100000:2.0:1787893020.361923:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787893020.361932:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907113d10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455549824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893020.361977:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907113d10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455549824:12345-0@lo:400:kworker.0 Request processed in 46us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893020.361984:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787893020.362003:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455549184 00000100:00100000:2.0:1787893020.362006:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455549184 00000100:00100000:2.0:1787893020.362025:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1787893020.362030:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+19:3308:x1874741455549184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893020.362053:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+19:3308:x1874741455549184:12345-0@lo:400:kworker.0 Request processed in 23us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893020.362059:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1787893020.362098:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907105afb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22d910cf-711e-44e0-9acf-212404ada550:3308:1874741455549184:0@lo:400:kworker.0 00000100:00100000:2.0:1787893020.362110:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907003899500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455549824:0@lo:400:kworker.0 00000100:00100000:2.0:1787893020.362145:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907003898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455549568:0@lo:400:kworker.0 00000100:00100000:2.0:1787893020.362166:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893020.362181:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787893020.362198:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907105afbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874741455549440:0@lo:400:kworker.0 00000100:00100000:2.0:1787893020.362217:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893020.362248:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455549312 00000100:00100000:2.0:1787893020.362251:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455549312 00000100:00100000:2.0:1787893020.362272:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455549696 00000100:00100000:2.0:1787893020.362274:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455549696 00000100:00100000:2.0:1787893020.362285:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455549440 00000100:00100000:2.0:1787893020.362287:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455549440 00000100:00100000:2.0:1787893020.362298:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787893020.362320:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907113d10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874741455549312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893020.362350:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907113d10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874741455549312:12345-0@lo:400:kworker.0 Request processed in 31us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893020.362356:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787893020.362366:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787893020.362371:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907113d12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874741455549696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893020.362390:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907113d12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874741455549696:12345-0@lo:400:kworker.0 Request processed in 20us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893020.362395:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787893020.362403:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787893020.362407:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907113d10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874741455549440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893020.362429:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907113d10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874741455549440:12345-0@lo:400:kworker.0 Request processed in 21us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893020.362434:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787893020.362455:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907105afbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874741455549440:0@lo:400:kworker.0 00000100:00100000:2.0:1787893020.362472:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907003898e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874741455549696:0@lo:400:kworker.0 00000100:00100000:2.0:1787893020.362481:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907105afb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874741455549312:0@lo:400:kworker.0 00000100:00080000:1.0:1787893020.362839:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787893020.362844:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787893020.363045:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455549568 00000100:00100000:3.0:1787893020.363051:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455549568 00000100:00100000:3.0:1787893020.363081:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787893020.363087:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907113d13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455549568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893020.363139:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907113d13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455549568:12345-0@lo:400:kworker.0 Request processed in 52us (972us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893020.363144:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:0.0:1787893020.364212:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff907003898000 x1874741455549568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787893036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893020.364229:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907003898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455549568:0@lo:400:kworker.0 00010000:00010000:1.0:1787893020.755411:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893020.874476:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455549952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787893020.874572:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893020.874783:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455549952 00000100:00100000:1.0:1787893020.874792:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455549952 00000100:00100000:1.0:1787893020.874847:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787893020.874856:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907113d13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455549952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787893020.874890:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787893020.874944:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907113d13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455549952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893020.874968:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787893020.875305:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455549952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787893021.657450:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893021.657681:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431395584 00000100:00100000:0.0:1787893021.657693:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431395584 00000100:00100000:0.0:1787893021.657806:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 32 00000100:00100000:0.0:1787893021.657818:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907113d13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+5:10235:x1874741431395584:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787893021.657841:0:8281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893021.657868:0:8281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9c00/0x825e3f5022b4a915 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821aeca expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893021.657950:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4a91c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893021.657964:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4a91c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893021.657977:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4a91c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893021.658200:0:8281:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787893021.658205:0:8281:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787893021.658307:0:8281:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4a91c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893021.658337:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9c00/0x825e3f5022b4a915 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aeca expref: 7 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893021.658354:0:8281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4a91c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aeca expref: 6 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893021.658369:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9071061f7400) 00010000:00010000:0.0:1787893021.658372:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00000100:00080000:1.0:1787893021.658635:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787893021.659327:0:8281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907137fc8000, rc 0) 00000100:00100000:0.0:1787893021.659542:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907113d13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+6:10235:x1874741431395584:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 Request processed in 1724us (2101us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893021.660450:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 32 00000100:00100000:1.0:1787893021.669934:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893021.670158:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431395712 00000100:00100000:2.0:1787893021.670171:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431395712 00000100:00100000:2.0:1787893021.670263:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 33 00000100:00100000:2.0:1787893021.670274:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f90c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+6:10236:x1874741431395712:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787893021.670297:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893021.670320:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8000/0x825e3f5022b4a923 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821aed1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893021.670680:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4a92a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893021.670697:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4a92a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893021.670709:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4a92a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893021.670723:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9200/0x825e3f5022b4a931 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893021.670730:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9200/0x825e3f5022b4a931 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893021.670736:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9200/0x825e3f5022b4a931 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893021.671213:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9c00/0x825e3f5022b4a938 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893021.671224:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9c00/0x825e3f5022b4a938 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893021.671232:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9c00/0x825e3f5022b4a938 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893021.671328:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787893021.671332:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787893021.671428:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9c00/0x825e3f5022b4a938 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893021.671440:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4a92a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893021.671446:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4a92a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893021.671453:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4a92a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893021.671459:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071102b8e00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893021.671464:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4a92a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893021.671471:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4a92a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893021.671485:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9071061f7400) 00010000:00010000:2.0:1787893021.671487:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893021.671491:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4a92a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893021.671496:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4a92a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893021.671507:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9200/0x825e3f5022b4a931 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893021.671537:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9200/0x825e3f5022b4a931 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893021.671543:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9200/0x825e3f5022b4a931 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893021.671558:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071102b9200 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893021.671561:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9200/0x825e3f5022b4a931 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893021.671567:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9200/0x825e3f5022b4a931 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893021.671575:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff907105cff300) 00010000:00010000:2.0:1787893021.671578:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893021.671581:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9200/0x825e3f5022b4a931 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893021.671587:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9200/0x825e3f5022b4a931 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893021.671620:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8000/0x825e3f5022b4a923 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aed1 expref: 8 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893021.671634:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9c00/0x825e3f5022b4a938 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aed1 expref: 7 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893021.671641:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff907105cffb00) 00010000:00010000:2.0:1787893021.671643:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787893021.671651:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071102b9c00, rc 0) 00000100:00100000:2.0:1787893021.671731:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f90c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+7:10236:x1874741431395712:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 Request processed in 1458us (1807us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893021.671738:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 33 00000100:00100000:2.0:1787893021.679816:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893021.680744:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431395968 00000100:00100000:0.0:1787893021.680785:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431395968 00000100:00100000:0.0:1787893021.680897:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 34 00000100:00100000:0.0:1787893021.680908:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907113d10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+7:10236:x1874741431395968:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787893021.680935:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893021.680963:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9c00/0x825e3f5022b4a93f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821aed8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893021.681069:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4a946 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893021.681084:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4a946 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893021.681097:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4a946 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893021.681162:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9200/0x825e3f5022b4a94d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893021.681171:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9200/0x825e3f5022b4a94d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893021.681177:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9200/0x825e3f5022b4a94d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893021.682065:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9600/0x825e3f5022b4a954 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893021.682079:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9600/0x825e3f5022b4a954 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893021.682087:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9600/0x825e3f5022b4a954 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893021.682109:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1787893021.682336:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4a946 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893021.682344:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4a946 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893021.682351:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4a946 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893021.682358:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc8200 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:0.0:1787893021.682362:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4a946 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893021.682369:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4a946 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893021.682993:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff907105cffb00) 00010000:00010000:0.0:1787893021.682997:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893021.683003:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4a946 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893021.683010:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4a946 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893021.683024:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9200/0x825e3f5022b4a94d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893021.683031:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9200/0x825e3f5022b4a94d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893021.683060:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9200/0x825e3f5022b4a94d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893021.683066:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc9200 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:0.0:1787893021.683069:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9200/0x825e3f5022b4a94d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893021.683076:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9200/0x825e3f5022b4a94d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893021.683084:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9071061f7a00) 00010000:00010000:0.0:1787893021.683087:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893021.683090:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9200/0x825e3f5022b4a94d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893021.683096:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9200/0x825e3f5022b4a94d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893021.686712:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9c00/0x825e3f5022b4a93f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aed8 expref: 10 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893021.686747:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9600/0x825e3f5022b4a954 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aed8 expref: 9 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893021.686775:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9071061f7700) 00010000:00010000:0.0:1787893021.686778:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893021.686782:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907137fc9600, rc 0) 00000100:00100000:0.0:1787893021.688013:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907113d10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+9:10236:x1874741431395968:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 Request processed in 7096us (8205us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787893021.694711:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 34 00000100:00100000:3.0:1787893021.694942:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893021.696124:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431396096 00000100:00100000:1.0:1787893021.696142:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431396096 00000100:00100000:1.0:1787893021.696205:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 35 00000100:00100000:1.0:1787893021.696215:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+9:10236:x1874741431396096:12345-192.168.202.29@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787893021.696361:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+9:10236:x1874741431396096:12345-192.168.202.29@tcp:59:lhsmtool_posix.0 Request processed in 139us (1413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893021.696369:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 35 00010000:00010000:0.0:1787893021.769650:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787893022.025461:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787893022.797066:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893023.289141:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893023.289250:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893023.289291:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893023.289335:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431396480 00000100:00100000:0.0:1787893023.289347:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431396480 00000100:00100000:0.0:1787893023.289407:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431396352 00000100:00100000:0.0:1787893023.289410:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431396352 00000100:00100000:0.0:1787893023.289431:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 131 00000100:00100000:0.0:1787893023.289441:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907003898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db96701a-d972-4021-b77b-4d58b82fa12c+5:2361:x1874741431396480:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1787893023.289528:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907003898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db96701a-d972-4021-b77b-4d58b82fa12c+5:2361:x1874741431396480:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 89us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893023.289545:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 131 00000100:00100000:0.0:1787893023.289561:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 132 00000100:00100000:0.0:1787893023.289568:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90700389bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+9:2361:x1874741431396352:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1787893023.289594:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90700389bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+9:2361:x1874741431396352:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 27us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893023.289599:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 132 00000100:00080000:1.0:1787893023.291541:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787893023.301804:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431396224 00000100:00100000:2.0:1787893023.301821:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431396224 00000100:00100000:2.0:1787893023.301893:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 284 00000100:00100000:2.0:1787893023.301904:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+13:2361:x1874741431396224:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1787893023.301990:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+13:2361:x1874741431396224:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 87us (12859us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893023.301997:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 284 00010000:00010000:1.0:1787893023.818985:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893023.962057:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893023.962555:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431396608 00000100:00100000:1.0:1787893023.962568:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431396608 00000100:00100000:1.0:1787893023.962676:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 36 00000100:00100000:1.0:1787893023.962687:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907003898e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+9:10279:x1874741431396608:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:1.0:1787893023.962828:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893023.962856:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4a962 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821aedf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893023.962935:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4a969 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893023.962951:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4a969 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893023.962965:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4a969 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893023.962989:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4a970 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893023.962997:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4a970 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893023.963003:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4a970 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893023.963365:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4a969 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893023.963375:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4a969 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893023.963390:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4a969 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893023.963395:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fa400 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:0.0:1787893023.963399:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4a969 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893023.963404:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4a969 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893023.963415:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9071061f7400) 00010000:00010000:0.0:1787893023.963417:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893023.963420:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4a969 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893023.963424:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4a969 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893023.963436:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4a970 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893023.963440:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4a970 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893023.963443:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4a970 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893023.963447:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fb400 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:0.0:1787893023.963449:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4a970 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893023.963457:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4a970 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893023.963462:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff907105907f00) 00010000:00010000:0.0:1787893023.963464:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893023.963465:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4a970 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893023.963468:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4a970 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893023.963495:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4a962 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aedf expref: 10 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893023.963501:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9071061f7400) 00010000:00010000:0.0:1787893023.963502:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893023.963504:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4a962 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aedf expref: 10 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893023.963510:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071421fa000, rc 0) 00000100:00100000:0.0:1787893023.963590:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907003898e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+9:10279:x1874741431396608:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 904us (1538us total) trans 0 rc 301/301 00000100:00100000:0.0:1787893023.963596:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 36 00000100:00100000:2.0:1787893023.979094:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893023.980879:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431396864 00000100:00100000:1.0:1787893023.980895:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431396864 00000100:00100000:1.0:1787893023.980974:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 37 00000100:00100000:1.0:1787893023.980986:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907113d12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+9:10279:x1874741431396864:12345-192.168.202.29@tcp:36:lfs.0 00010000:00010000:1.0:1787893023.981051:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893023.981078:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4a91c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aeca expref: 9 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893023.981099:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9071061f7400) 00010000:00010000:1.0:1787893023.981109:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787893023.982044:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4a977 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893023.982065:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4a977 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893023.982078:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4a977 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893023.982091:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fbe00/0x825e3f5022b4a97e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893023.982107:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fbe00/0x825e3f5022b4a97e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893023.982113:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fbe00/0x825e3f5022b4a97e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893023.985094:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787893023.985115:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4a977 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893023.985127:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4a977 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893023.985136:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4a977 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893023.985142:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fb600 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893023.985146:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4a977 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893023.985155:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4a977 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893023.985171:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907105907800) 00010000:00010000:1.0:1787893023.985173:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893023.985177:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4a977 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893023.985183:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4a977 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787893023.986967:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000074fe8351 reply state 00000000d32bea6d transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fbe00/0x825e3f5022b4a97e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893023.986984:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787893023.987467:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907113d12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+10:10279:x1874741431396864:12345-192.168.202.29@tcp:36:lfs.0 Request processed in 6478us (8378us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787893023.987478:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 37 00010000:00010000:3.0:1787893023.992257:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fbe00/0x825e3f5022b4a97e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893023.992275:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fbe00/0x825e3f5022b4a97e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893023.992294:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fbe00/0x825e3f5022b4a97e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893023.992299:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fbe00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893023.992305:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fbe00/0x825e3f5022b4a97e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893023.992311:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fbe00/0x825e3f5022b4a97e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893023.992330:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff907105907100) 00010000:00010000:3.0:1787893023.992401:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893023.992407:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fbe00/0x825e3f5022b4a97e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893023.992414:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fbe00/0x825e3f5022b4a97e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893024.132385:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893024.132510:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431396992 00000100:00100000:1.0:1787893024.132521:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431396992 00000100:00100000:1.0:1787893024.132597:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 38 00000100:00100000:1.0:1787893024.132608:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907113d12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+9:10287:x1874741431396992:12345-192.168.202.29@tcp:101:lctl.0 00010000:00010000:1.0:1787893024.132634:0:8281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893024.132657:0:8281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4a985 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821aee6 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893024.132730:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fbe00/0x825e3f5022b4a98c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893024.132746:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fbe00/0x825e3f5022b4a98c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893024.132794:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fbe00/0x825e3f5022b4a98c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893024.133037:0:8281:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787893024.133042:0:8281:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787893024.133089:0:8281:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fbe00/0x825e3f5022b4a98c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893024.133135:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4a985 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aee6 expref: 11 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893024.133158:0:8281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fbe00/0x825e3f5022b4a98c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aee6 expref: 10 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893024.133167:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907105907600) 00010000:00010000:1.0:1787893024.133169:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787893024.133174:0:8281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071421fbe00, rc 0) 00000100:00100000:1.0:1787893024.133226:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907113d12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+10:10287:x1874741431396992:12345-192.168.202.29@tcp:101:lctl.0 Request processed in 621us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893024.133234:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 38 00000100:00100000:0.0:1787893024.191269:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893024.191378:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431397120 00000100:00100000:2.0:1787893024.191391:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431397120 00000100:00100000:2.0:1787893024.191458:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 39 00000100:00100000:2.0:1787893024.191469:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907003899500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+10:10293:x1874741431397120:12345-192.168.202.29@tcp:101:bash.0 00010000:00010000:2.0:1787893024.191491:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893024.191516:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9000/0x825e3f5022b4a993 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821aeed expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.191595:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4a99a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.191611:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4a99a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.191642:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4a99a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.191659:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8400/0x825e3f5022b4a9a1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.191666:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8400/0x825e3f5022b4a9a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.191672:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8400/0x825e3f5022b4a9a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.191830:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8000/0x825e3f5022b4a9a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.191839:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8000/0x825e3f5022b4a9a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.191846:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8000/0x825e3f5022b4a9a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893024.191880:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1787893024.191884:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787893024.191929:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8000/0x825e3f5022b4a9a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.192064:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4a99a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.192070:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4a99a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.192088:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4a99a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.192095:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071102b9a00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893024.192099:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4a99a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.192106:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4a99a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.192121:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907105907600) 00010000:00010000:2.0:1787893024.192124:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893024.192128:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4a99a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.192207:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4a99a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.192222:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8400/0x825e3f5022b4a9a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.192228:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8400/0x825e3f5022b4a9a1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.192233:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8400/0x825e3f5022b4a9a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.192238:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071102b8400 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893024.192241:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8400/0x825e3f5022b4a9a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.192256:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8400/0x825e3f5022b4a9a1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.192264:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff907105cff300) 00010000:00010000:2.0:1787893024.192266:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893024.192269:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8400/0x825e3f5022b4a9a1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.192274:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8400/0x825e3f5022b4a9a1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.192309:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9000/0x825e3f5022b4a993 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aeed expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.192322:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8000/0x825e3f5022b4a9a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aeed expref: 11 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.192329:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff907105cff400) 00010000:00010000:2.0:1787893024.192331:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787893024.192333:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071102b8000, rc 0) 00000100:00100000:2.0:1787893024.192409:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907003899500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+11:10293:x1874741431397120:12345-192.168.202.29@tcp:101:bash.0 Request processed in 940us (1145us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893024.192417:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 39 00000100:00100000:2.0:1787893024.195862:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893024.195958:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431397376 00000100:00100000:1.0:1787893024.195971:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431397376 00000100:00100000:1.0:1787893024.196048:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 40 00000100:00100000:1.0:1787893024.196058:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907113d11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+11:10293:x1874741431397376:12345-192.168.202.29@tcp:101:bash.0 00010000:00010000:1.0:1787893024.196188:0:8281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893024.196207:0:8281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4a9af lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821aef4 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893024.196323:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4a9b6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893024.196335:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4a9b6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893024.196342:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4a9b6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893024.196402:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4a9bd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893024.196408:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4a9bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893024.196413:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4a9bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787893024.197422:0:8281:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1787893024.197616:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4a9c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893024.198020:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4a9c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893024.198175:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4a9c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893024.198210:0:8281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4a9b6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893024.198215:0:8281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4a9b6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893024.198352:0:8281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4a9b6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893024.198358:0:8281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fa000 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893024.198361:0:8281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4a9b6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893024.198377:0:8281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4a9b6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893024.198388:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff907105cff400) 00010000:00010000:1.0:1787893024.198390:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893024.198393:0:8281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4a9b6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893024.198399:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4a9b6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787893024.198418:0:8281:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d312225c reply state 00000000f999d5d9 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4a9bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893024.198427:0:8281:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787893024.198467:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4a9af lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aef4 expref: 14 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893024.198482:0:8281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4a9c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aef4 expref: 13 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893024.198489:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105907900) 00010000:00010000:1.0:1787893024.198491:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787893024.198494:0:8281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071421fa400, rc 0) 00000100:00100000:1.0:1787893024.198637:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907113d11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+14:10293:x1874741431397376:12345-192.168.202.29@tcp:101:bash.0 Request processed in 2579us (2787us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787893024.198646:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 40 00010000:00010000:3.0:1787893024.200307:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4a9bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893024.200318:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4a9bd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893024.200323:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4a9bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893024.200326:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fb400 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893024.200330:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4a9bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893024.200348:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4a9bd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893024.200359:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff907105907800) 00010000:00010000:3.0:1787893024.200361:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893024.200364:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4a9bd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893024.200369:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4a9bd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893024.205099:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893024.205414:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431397504 00000100:00100000:0.0:1787893024.205428:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431397504 00000100:00100000:0.0:1787893024.205480:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 20 00000100:00100000:0.0:1787893024.205497:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105afb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2359:x1874741431397504:12345-192.168.202.29@tcp:8:bash.0 00010000:00080000:0.0:1787893024.205554:0:6702:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 4829748d-dde1-497a-9623-0e4326f0972c@192.168.202.29@tcp t0 exp 0000000000000000 cur 351 last 0 00000020:00000080:0.0:1787893024.205587:0:6702:0:(genops.c:1385:class_connect()) connect: client 4829748d-dde1-497a-9623-0e4326f0972c, cookie 0x825e3f5022b4a9d2 00002000:00100000:0.0:1787893024.205600:0:6702:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4829748d-dde1-497a-9623-0e4326f0972c/ffff9071184ad000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787893024.205865:0:6702:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787893024.206143:0:6702:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787893024.206178:0:6702:0:(import.c:65:import_set_state_nolock()) ffff9071184a9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787893024.206400:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105afb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4829748d-dde1-497a-9623-0e4326f0972c+6:2359:x1874741431397504:12345-192.168.202.29@tcp:8:bash.0 Request processed in 900us (1307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893024.206408:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 20 00000100:00100000:0.0:1787893024.214437:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893024.214716:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431397632 00000100:00100000:3.0:1787893024.214728:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431397632 00000100:00100000:3.0:1787893024.214882:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 21 00000100:00100000:3.0:1787893024.214893:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e5c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4829748d-dde1-497a-9623-0e4326f0972c+6:0:x1874741431397632:12345-192.168.202.29@tcp:101:bash.0 00010000:00010000:3.0:1787893024.214912:0:8105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893024.214938:0:8105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f700353/0x825e3f5022b4a9d9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821aefb expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787893024.214968:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787893024.214998:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=351s v=(0 0) 00010000:00010000:3.0:1787893024.215003:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893024.215012:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f700353/0x825e3f5022b4a9d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aefb expref: 7 pid: 8105 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893024.215045:0:8105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006f700353/0x825e3f5022b4a9d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aefb expref: 7 pid: 8105 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893024.215086:0:8105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907104f46800, rc 0) 00000100:00100000:3.0:1787893024.215151:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e5c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4829748d-dde1-497a-9623-0e4326f0972c+7:0:x1874741431397632:12345-192.168.202.29@tcp:101:bash.0 Request processed in 258us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893024.215159:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 21 00000100:00080000:1.0:1787893024.216826:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787893024.219894:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893024.220086:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431397760 00000100:00100000:2.0:1787893024.220096:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431397760 00000100:00100000:2.0:1787893024.220147:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 22 00000100:00100000:2.0:1787893024.220170:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4829748d-dde1-497a-9623-0e4326f0972c+7:10293:x1874741431397760:12345-192.168.202.29@tcp:101:bash.0 00010000:00010000:2.0:1787893024.220187:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893024.220209:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af639c3f/0x825e3f5022b4a9e0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821af02 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.220237:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006f700353/0x825e3f5022b4a9d9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aefb expref: 8 pid: 8105 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.220246:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893024.220250:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893024.220255:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af639c3f/0x825e3f5022b4a9e0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af02 expref: 8 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.220289:0:6700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006f700353/0x825e3f5022b4a9d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aefb expref: 8 pid: 8105 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.220304:0:6700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006f700353/0x825e3f5022b4a9d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aefb expref: 8 pid: 8105 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893024.220320:0:6700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907105afbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6700:1874741455550080:192.168.202.29@tcp:104: 00000100:00100000:2.0:1787893024.220436:0:6700:0:(client.c:2715:ptlrpc_set_wait()) set ffff907108643000 going to sleep for 11 seconds 00000100:00100000:0.0:1787893024.224976:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893024.225224:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431397888 00000100:00100000:3.0:1787893024.225234:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431397888 00010000:00010000:3.0:1787893024.225273:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006f700353/0x825e3f5022b4a9d9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aefb expref: 9 pid: 8105 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893024.225315:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 35 00000100:00100000:3.0:1787893024.225325:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e5c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4829748d-dde1-497a-9623-0e4326f0972c+9:2361:x1874741431397888:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787893024.225339:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893024.225363:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006f700353/0x825e3f5022b4a9d9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aefb expref: 9 pid: 8105 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893024.225376:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006f700353/0x825e3f5022b4a9d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aefb expref: 9 pid: 8105 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893024.225401:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893024.225405:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893024.225414:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000af639c3f/0x825e3f5022b4a9e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af02 expref: 9 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893024.225441:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af639c3f/0x825e3f5022b4a9e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af02 expref: 9 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893024.225480:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000af639c3f/0x825e3f5022b4a9e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af02 expref: 9 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893024.225567:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d12d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5834:1874741455550208:192.168.202.29@tcp:105: 00010000:00010000:2.0:1787893024.225913:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f700353/0x825e3f5022b4a9d9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aefb expref: 9 pid: 8105 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893024.225930:0:6700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907105afbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6700:1874741455550080:192.168.202.29@tcp:104: 00010000:00010000:2.0:1787893024.225966:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000af639c3f/0x825e3f5022b4a9e0 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af02 expref: 8 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.225977:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071102b9000, rc 0) 00000100:00100000:2.0:1787893024.226009:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4829748d-dde1-497a-9623-0e4326f0972c+8:10293:x1874741431397760:12345-192.168.202.29@tcp:101:bash.0 Request processed in 5841us (6129us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893024.226016:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 22 00000100:00100000:3.0:1787893024.226579:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071091459c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787893024.236043:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d12d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5834:1874741455550208:192.168.202.29@tcp:105: 00010000:00010000:3.0:1787893024.236080:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893024.236142:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e5c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4829748d-dde1-497a-9623-0e4326f0972c+7:2361:x1874741431397888:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 10817us (11175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893024.236154:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 35 00000100:00100000:1.0:1787893024.238282:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893024.238393:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431398144 00000100:00100000:0.0:1787893024.238403:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431398144 00000100:00100000:0.0:1787893024.238465:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 6 00000100:00100000:0.0:1787893024.238475:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f90f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+13:10293:x1874741431398144:12345-192.168.202.29@tcp:35:bash.0 00000001:00080000:0.0:1787893024.238961:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967312 00000100:00100000:0.0:1787893024.239272:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f90f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+15:10293:x1874741431398144:12345-192.168.202.29@tcp:35:bash.0 Request processed in 796us (997us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1787893024.239280:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 6 00000020:00080000:0.0:1787893024.239284:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787893024.343009:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893024.343167:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431398400 00000100:00100000:2.0:1787893024.343177:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431398400 00000100:00100000:2.0:1787893024.343268:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 41 00000100:00100000:2.0:1787893024.343278:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+15:10303:x1874741431398400:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:2.0:1787893024.343303:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893024.343323:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8400/0x825e3f5022b4a9e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821af09 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893024.343430:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787893024.343560:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8400/0x825e3f5022b4a9e7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af09 expref: 17 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.343575:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907105907600) 00010000:00010000:2.0:1787893024.343578:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787893024.343583:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8400/0x825e3f5022b4a9e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af09 expref: 17 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.343598:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071102b8400, rc 0) 00000100:00100000:2.0:1787893024.343665:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+16:10303:x1874741431398400:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 388us (668us total) trans 4294967314 rc 301/301 00000100:00100000:2.0:1787893024.343686:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 41 00000100:00100000:3.0:1787893024.346398:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893024.346570:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431398656 00000100:00100000:0.0:1787893024.346580:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431398656 00000100:00100000:0.0:1787893024.346673:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 7 00000100:00100000:0.0:1787893024.346685:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+16:10303:x1874741431398656:12345-192.168.202.29@tcp:35:lfs.0 00000100:00100000:0.0:1787893024.347004:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+17:10303:x1874741431398656:12345-192.168.202.29@tcp:35:lfs.0 Request processed in 322us (617us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1787893024.347012:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 7 00000100:00100000:3.0:1787893024.444108:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893024.444292:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431398784 00000100:00100000:0.0:1787893024.444303:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431398784 00000100:00100000:0.0:1787893024.444367:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 42 00000100:00100000:0.0:1787893024.444379:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+17:10309:x1874741431398784:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:0.0:1787893024.444406:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893024.444429:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4a9f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821af10 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.444519:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8600/0x825e3f5022b4a9fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.444542:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8600/0x825e3f5022b4a9fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.444554:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8600/0x825e3f5022b4a9fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893024.444615:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1787893024.444618:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787893024.444641:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8600/0x825e3f5022b4a9fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.444668:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4a9f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af10 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.444688:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8600/0x825e3f5022b4a9fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af10 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.444711:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff907105cff400) 00010000:00010000:0.0:1787893024.444714:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787893024.444718:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907137fc8600, rc 0) 00000100:00100000:0.0:1787893024.444831:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+18:10309:x1874741431398784:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 454us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893024.444838:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 42 00000100:00100000:1.0:1787893024.451623:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893024.451722:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431399040 00000100:00100000:2.0:1787893024.451733:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431399040 00000100:00100000:2.0:1787893024.451924:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 43 00000100:00100000:2.0:1787893024.451935:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f90dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+18:10309:x1874741431399040:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:2.0:1787893024.451970:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893024.451992:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4aa03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821af17 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.452109:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9200/0x825e3f5022b4aa0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.452125:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9200/0x825e3f5022b4aa0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.452136:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9200/0x825e3f5022b4aa0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893024.452147:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787893024.452274:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4aa03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af17 expref: 21 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.452293:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9200/0x825e3f5022b4aa0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af17 expref: 20 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.452303:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105907900) 00010000:00010000:2.0:1787893024.452306:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787893024.452309:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071102b9200, rc 0) 00000100:00100000:2.0:1787893024.452392:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f90dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+20:10309:x1874741431399040:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 458us (779us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787893024.452401:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 43 00000100:00100000:0.0:1787893024.459331:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f90df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455550336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787893024.459411:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893024.459699:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455550336 00000100:00100000:3.0:1787893024.459708:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455550336 00000100:00100000:3.0:1787893024.459785:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787893024.459796:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455550336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787893024.459820:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787893024.459870:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455550336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893024.459877:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787893024.459927:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f90df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455550336:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787893024.460025:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787893024.473360:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893024.473412:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893024.473586:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431399424 00000100:00100000:2.0:1787893024.473597:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431399424 00000100:00100000:2.0:1787893024.473649:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 44 00000100:00100000:2.0:1787893024.473659:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105afb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+20:10309:x1874741431399424:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:2.0:1787893024.473687:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893024.473707:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4aa18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821af1e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.473840:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4aa1f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.473856:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4aa1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.473866:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4aa1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893024.473877:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00000100:00100000:1.0:1787893024.474724:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431399168 00000100:00100000:1.0:1787893024.474730:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431399168 00000100:00100000:1.0:1787893024.474785:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 2 00000100:00100000:1.0:1787893024.474794:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105afbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4829748d-dde1-497a-9623-0e4326f0972c+23:2361:x1874741431399168:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893024.474806:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893024.474824:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9200/0x825e3f5022b4aa0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af17 expref: 23 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893024.474841:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105907900) 00010000:00010000:1.0:1787893024.474846:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893024.474903:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105afbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4829748d-dde1-497a-9623-0e4326f0972c+22:2361:x1874741431399168:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 109us (1555us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893024.474911:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 2 00010000:00010000:2.0:1787893024.475963:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4aa18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af1e expref: 22 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.475985:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4aa1f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af1e expref: 21 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.476009:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105907900) 00010000:00010000:2.0:1787893024.476012:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787893024.476015:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071102b8e00, rc 0) 00000100:00100000:2.0:1787893024.476993:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105afb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+21:10309:x1874741431399424:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 3329us (3574us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1787893024.477002:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 44 00000100:00100000:3.0:1787893024.489327:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893024.489507:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431399552 00000100:00100000:3.0:1787893024.489518:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431399552 00000100:00100000:3.0:1787893024.489597:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 23 00000100:00100000:3.0:1787893024.489608:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4829748d-dde1-497a-9623-0e4326f0972c+7:2360:x1874741431399552:12345-192.168.202.29@tcp:1:lfs.0 00010000:00010000:3.0:1787893024.489650:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060d3b585/0x825e3f5022b4aa2d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893024.489673:0:8105:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000af639c3f/0x825e3f5022b4a9e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af02 expref: 7 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893024.489683:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787893024.489688:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787893024.489692:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060d3b585/0x825e3f5022b4aa2d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893024.489743:0:8105:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000af639c3f/0x825e3f5022b4a9e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af02 expref: 7 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893024.489796:0:8105:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000af639c3f/0x825e3f5022b4a9e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af02 expref: 7 pid: 6700 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893024.489812:0:8105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f57d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8105:1874741455550464:192.168.202.29@tcp:104: 00000100:00100000:3.0:1787893024.489900:0:8105:0:(client.c:2715:ptlrpc_set_wait()) set ffff907109145b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787893024.494178:0:8105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f57d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8105:1874741455550464:192.168.202.29@tcp:104: 00010000:00010000:2.0:1787893024.494208:0:8105:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000060d3b585/0x825e3f5022b4aa2d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893024.494748:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893024.495143:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431399680 00000100:00100000:0.0:1787893024.495154:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431399680 00002000:00100000:0.0:1787893024.495198:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff90713f57d500 x1874741431399680/t0(0) o4->4829748d-dde1-497a-9623-0e4326f0972c@192.168.202.29@tcp:185/0 lens 504/0 e 0 to 0 dl 1787893035 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787893024.495206:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90713f57d500 with x1874741431399680 ext(0->12) 00010000:00010000:0.0:1787893024.495212:0:6705:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000af639c3f/0x825e3f5022b4a9e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af02 expref: 8 pid: 6700 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.495223:0:6705:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000af639c3f/0x825e3f5022b4a9e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af02 expref: 8 pid: 6700 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787893024.495229:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90713f57d500 00000100:00100000:0.0:1787893024.495247:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 0 00000100:00100000:0.0:1787893024.495253:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f57d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4829748d-dde1-497a-9623-0e4326f0972c+8:2361:x1874741431399680:12345-192.168.202.29@tcp:4:lfs.0 00000001:00080000:0.0:1787893024.516796:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967315 is committed 00000001:00080000:0.0:1787893024.516839:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967316 is committed 00000001:00100000:2.0:1787893024.518897:0:6725:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4829748d-dde1-497a-9623-0e4326f0972c 00000100:00100000:0.0:1787893024.519687:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f57d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4829748d-dde1-497a-9623-0e4326f0972c+9:2361:x1874741431399680:12345-192.168.202.29@tcp:4:lfs.0 Request processed in 24425us (24937us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787893024.519700:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 0 00002000:00100000:0.0:1787893024.519714:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff90713f57d500 x1874741431399680/t4294967299(0) o4->4829748d-dde1-497a-9623-0e4326f0972c@192.168.202.29@tcp:185/0 lens 504/448 e 0 to 0 dl 1787893035 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787893024.519725:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90713f57d500 with x1874741431399680 ext(0->12) 00010000:00010000:0.0:1787893024.519736:0:6705:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000af639c3f/0x825e3f5022b4a9e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af02 expref: 9 pid: 6700 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.519786:0:6705:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000af639c3f/0x825e3f5022b4a9e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af02 expref: 9 pid: 6700 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787893024.519797:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90713f57d500 00000100:00100000:3.0:1787893024.522861:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893024.523368:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431399808 00000100:00100000:0.0:1787893024.523378:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431399808 00010000:00010000:0.0:1787893024.523422:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000af639c3f/0x825e3f5022b4a9e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af02 expref: 9 pid: 6700 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893024.523479:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 36 00000100:00100000:0.0:1787893024.523501:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f57c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4829748d-dde1-497a-9623-0e4326f0972c+9:2360:x1874741431399808:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893024.523518:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787893024.523549:0:5833:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787893024.523552:0:5833:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787893024 00002000:00010000:0.0:1787893024.523554:0:5833:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787893024 00002000:00010000:0.0:1787893024.523556:0:5833:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787893024 00010000:00010000:0.0:1787893024.523563:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000af639c3f/0x825e3f5022b4a9e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af02 expref: 9 pid: 6700 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.523587:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000af639c3f/0x825e3f5022b4a9e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af02 expref: 9 pid: 6700 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.523616:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af639c3f/0x825e3f5022b4a9e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af02 expref: 9 pid: 6700 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.523649:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787893024.523654:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787893024.523661:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000060d3b585/0x825e3f5022b4aa2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.523672:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060d3b585/0x825e3f5022b4aa2d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.523709:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893024.523833:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f57c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4829748d-dde1-497a-9623-0e4326f0972c+8:2360:x1874741431399808:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 344us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893024.523840:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 36 00010000:00010000:2.0:1787893024.524662:0:8105:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000060d3b585/0x825e3f5022b4aa2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.524677:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060d3b585/0x825e3f5022b4aa2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.524704:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060d3b585/0x825e3f5022b4aa2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.524712:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060d3b585/0x825e3f5022b4aa2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.524721:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060d3b585/0x825e3f5022b4aa2d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.524739:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f46200 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:2.0:1787893024.524743:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060d3b585/0x825e3f5022b4aa2d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.524788:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060d3b585/0x825e3f5022b4aa2d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.524808:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060d3b585/0x825e3f5022b4aa2d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.524825:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060d3b585/0x825e3f5022b4aa2d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893024.524908:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4829748d-dde1-497a-9623-0e4326f0972c+7:2360:x1874741431399552:12345-192.168.202.29@tcp:1:lfs.0 Request processed in 35300us (35837us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893024.524917:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 23 00000100:00100000:3.0:1787893024.527892:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893024.527991:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431400064 00000100:00100000:2.0:1787893024.528002:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431400064 00000100:00100000:2.0:1787893024.528151:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 8 00000100:00100000:2.0:1787893024.528163:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f57e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+13:10309:x1874741431400064:12345-192.168.202.29@tcp:35:lfs.0 00000004:00010000:2.0:1787893024.528224:0:5851:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4aa1f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af1e expref: 13 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787893024.528573:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1787893024.528620:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:2.0:1787893024.530748:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00010000:00010000:2.0:1787893024.531287:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4aa34 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.531312:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4a9c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aef4 expref: 17 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.531321:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4aa34 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.531391:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4a9c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aef4 expref: 17 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.531411:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4a9c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aef4 expref: 17 pid: 8281 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893024.531432:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907108387480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5851:1874741455550592:192.168.202.29@tcp:104: 00000100:00100000:2.0:1787893024.531710:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff907108643600 going to sleep for 11 seconds 00000100:00100000:3.0:1787893024.534564:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893024.534703:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907108387480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5851:1874741455550592:192.168.202.29@tcp:104: 00010000:00010000:2.0:1787893024.534732:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4aa34 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893024.535310:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431400192 00000100:00100000:1.0:1787893024.535321:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431400192 00010000:00010000:1.0:1787893024.535362:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4a9c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aef4 expref: 18 pid: 8281 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893024.535451:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 37 00000100:00100000:1.0:1787893024.535462:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f57f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4829748d-dde1-497a-9623-0e4326f0972c+18:2361:x1874741431400192:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893024.535477:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893024.535495:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4a9c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aef4 expref: 18 pid: 8281 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893024.535509:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4a9c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aef4 expref: 18 pid: 8281 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893024.535555:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4a9c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aef4 expref: 18 pid: 8281 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893024.535576:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105907900) 00010000:00010000:1.0:1787893024.535581:0:8463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4aa34 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893024.535589:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4aa34 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893024.535596:0:8463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4aa34 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893024.535643:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893024.535705:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f57f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4829748d-dde1-497a-9623-0e4326f0972c+17:2361:x1874741431400192:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 244us (1271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893024.535713:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 37 00010000:00010000:2.0:1787893024.535778:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4aa34 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.535786:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4aa34 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787893024.535914:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000001:00080000:2.0:1787893024.536120:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1787893024.536229:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907108387480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5851:1874741455550720:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787893024.536281:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893024.536313:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff907108643b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787893024.536341:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455550720 00000100:00100000:2.0:1787893024.536347:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455550720 00000100:00100000:2.0:1787893024.536378:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787893024.536385:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907108387b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5851:x1874741455550720:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787893024.536450:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907108387b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5851:x1874741455550720:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 66us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893024.536457:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787893024.536492:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907108387480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5851:1874741455550720:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787893024.537120:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:2.0:1787893024.537177:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907108387480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5851:1874741455550848:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787893024.537223:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893024.537248:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455550848 00000100:00100000:2.0:1787893024.537252:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455550848 00000100:00100000:2.0:1787893024.537276:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787893024.537282:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907108384e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5851:x1874741455550848:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787893024.537422:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907108384e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5851:x1874741455550848:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 139us (198us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787893024.537428:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787893024.537652:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff907108643600 going to sleep for 11 seconds 00000100:00100000:2.0:1787893024.537672:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907108387480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5851:1874741455550848:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787893024.537709:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1787893024.537738:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4aa34 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.537782:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4aa34 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.537789:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4aa34 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.537795:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071102b9a00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893024.537800:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4aa34 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.537808:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4aa34 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.537828:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105907900) 00010000:00010000:2.0:1787893024.537832:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787893024.537838:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4aa34 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.537845:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4aa34 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787893024.538026:0:5851:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787893024.538230:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1787893024.538241:0:5851:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 352305488135ns, next at 353305486282ns, rc = 0 00000001:00080000:2.0:1787893024.538247:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:2.0:1787893024.538276:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105907900) 00010000:00010000:2.0:1787893024.538279:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787893024.538286:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4aa1f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af1e expref: 21 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893024.538400:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f57e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+20:10309:x1874741431400064:12345-192.168.202.29@tcp:35:lfs.0 Request processed in 10239us (10517us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1787893024.538409:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 8 00000020:00080000:2.0:1787893024.538413:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787893024.541987:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893024.542147:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431400320 00000100:00100000:2.0:1787893024.542159:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431400320 00000100:00100000:2.0:1787893024.542261:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 45 00000100:00100000:2.0:1787893024.542272:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f90ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+20:10309:x1874741431400320:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:2.0:1787893024.542297:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893024.542319:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9600/0x825e3f5022b4aa3b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821af25 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.542418:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9600/0x825e3f5022b4aa3b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af25 expref: 21 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.542434:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9600/0x825e3f5022b4aa3b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af25 expref: 21 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.542469:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105cff300) 00010000:00010000:2.0:1787893024.542472:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787893024.542476:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071102b9600, rc 0) 00000100:00100000:2.0:1787893024.542568:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f90ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+21:10309:x1874741431400320:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 297us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893024.542575:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 45 00000100:00100000:0.0:1787893024.548239:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893024.548436:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431400576 00000100:00100000:1.0:1787893024.548514:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431400576 00000100:00100000:1.0:1787893024.548628:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 9 00000100:00100000:1.0:1787893024.548638:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713044fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+21:10309:x1874741431400576:12345-192.168.202.29@tcp:35:lfs.0 00000100:00100000:1.0:1787893024.548955:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713044fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+22:10309:x1874741431400576:12345-192.168.202.29@tcp:35:lfs.0 Request processed in 317us (727us total) trans 4294967327 rc 0/0 00000100:00100000:1.0:1787893024.548964:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 9 00000100:00100000:3.0:1787893024.718899:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893024.719098:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431400832 00000100:00100000:0.0:1787893024.719109:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431400832 00000100:00100000:0.0:1787893024.719178:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 46 00000100:00100000:0.0:1787893024.719189:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f57dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+22:10319:x1874741431400832:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:0.0:1787893024.719214:0:8281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893024.719235:0:8281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4aa42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821af2c expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893024.719674:0:8281:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1787893024.719910:0:8281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4aa42 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af2c expref: 24 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.719927:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907105907600) 00010000:00010000:0.0:1787893024.719930:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787893024.719935:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4aa42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af2c expref: 24 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.719947:0:8281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907137fc8000, rc 0) 00000100:00100000:0.0:1787893024.720020:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f57dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+23:10319:x1874741431400832:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 833us (1131us total) trans 4294967328 rc 301/301 00000100:00100000:0.0:1787893024.720029:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 46 00000100:00100000:3.0:1787893024.723244:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893024.723335:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431400960 00000100:00100000:0.0:1787893024.723346:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431400960 00000100:00100000:0.0:1787893024.723412:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 47 00000100:00100000:0.0:1787893024.723422:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f57df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+23:10319:x1874741431400960:12345-192.168.202.29@tcp:34:lfs.0 00010000:00010000:0.0:1787893024.723517:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4aa50 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.723544:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4aa50 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.723556:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4aa50 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.723573:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9000/0x825e3f5022b4aa57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.723594:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9000/0x825e3f5022b4aa57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.723602:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9000/0x825e3f5022b4aa57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.723882:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4aa5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.723891:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4aa5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.723899:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4aa5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787893024.723937:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4aa5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.723948:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4aa50 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.723955:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4aa50 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.723962:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4aa50 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.723968:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc9800 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:0.0:1787893024.723973:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4aa50 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.723980:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4aa50 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.723996:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff907105cff400) 00010000:00010000:0.0:1787893024.723999:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893024.724004:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4aa50 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.724010:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4aa50 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.724021:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9000/0x825e3f5022b4aa57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.724027:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9000/0x825e3f5022b4aa57 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.724041:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9000/0x825e3f5022b4aa57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.724048:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc9000 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:0.0:1787893024.724050:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9000/0x825e3f5022b4aa57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.724056:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9000/0x825e3f5022b4aa57 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.724063:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9071061f7e00) 00010000:00010000:0.0:1787893024.725029:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893024.725035:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9000/0x825e3f5022b4aa57 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.725236:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9000/0x825e3f5022b4aa57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.725270:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4aa5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.725276:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4aa5e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.725283:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4aa5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.725288:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc9a00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:0.0:1787893024.725291:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4aa5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.725297:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4aa5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.725515:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105cff300) 00010000:00010000:0.0:1787893024.725527:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893024.725531:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4aa5e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.725538:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4aa5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893024.725647:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f57df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+23:10319:x1874741431400960:12345-192.168.202.29@tcp:34:lfs.0 Request processed in 2222us (2410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893024.725656:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 47 00000100:00100000:3.0:1787893024.729849:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893024.730606:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431401216 00000100:00100000:2.0:1787893024.730618:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431401216 00000100:00100000:2.0:1787893024.730743:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 10 00000100:00100000:2.0:1787893024.730795:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f57ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+23:10319:x1874741431401216:12345-192.168.202.29@tcp:35:lfs.0 00000100:00100000:2.0:1787893024.732683:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f57ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+24:10319:x1874741431401216:12345-192.168.202.29@tcp:35:lfs.0 Request processed in 1733us (2649us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1787893024.732696:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 10 00000100:00100000:1.0:1787893024.812584:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893024.812815:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431401472 00000100:00100000:0.0:1787893024.812827:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431401472 00000100:00100000:0.0:1787893024.812947:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 48 00000100:00100000:0.0:1787893024.812972:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f90f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+24:10322:x1874741431401472:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:0.0:1787893024.812996:0:8281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893024.813026:0:8281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4aa65 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821af33 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.813119:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9000/0x825e3f5022b4aa6c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.813134:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9000/0x825e3f5022b4aa6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.813146:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9000/0x825e3f5022b4aa6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.813162:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4aa73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.813169:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4aa73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.813176:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4aa73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.813513:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4aa7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.813533:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4aa7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.813541:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4aa7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893024.813562:0:8281:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787893024.813668:0:8281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9000/0x825e3f5022b4aa6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.813676:0:8281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9000/0x825e3f5022b4aa6c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.813682:0:8281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9000/0x825e3f5022b4aa6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.813689:0:8281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc9000 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:0.0:1787893024.813693:0:8281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9000/0x825e3f5022b4aa6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.813701:0:8281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9000/0x825e3f5022b4aa6c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.813713:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff907105cff400) 00010000:00010000:0.0:1787893024.813716:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893024.813721:0:8281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9000/0x825e3f5022b4aa6c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.813727:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9000/0x825e3f5022b4aa6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.813739:0:8281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4aa73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.813745:0:8281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4aa73 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.813814:0:8281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4aa73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.813819:0:8281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc9800 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:0.0:1787893024.813822:0:8281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4aa73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.813829:0:8281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4aa73 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.813838:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9071061f7e00) 00010000:00010000:0.0:1787893024.813840:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893024.813843:0:8281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4aa73 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.813849:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4aa73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.813891:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4aa65 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af33 expref: 27 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.813905:0:8281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4aa7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af33 expref: 26 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893024.813913:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105cff300) 00010000:00010000:0.0:1787893024.813915:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787893024.813917:0:8281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907137fc8000, rc 0) 00000100:00100000:0.0:1787893024.813980:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f90f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+26:10322:x1874741431401472:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 1011us (1405us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1787893024.813996:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 48 00000100:00100000:3.0:1787893024.817070:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893024.823578:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431401600 00000100:00100000:2.0:1787893024.823599:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431401600 00000100:00100000:2.0:1787893024.825791:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 49 00000100:00100000:2.0:1787893024.825805:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f57c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+26:10322:x1874741431401600:12345-192.168.202.29@tcp:54:lfs.0 00010000:00010000:2.0:1787893024.825873:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4aa88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.825890:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4aa88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.825902:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4aa88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.825928:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4aa88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.825935:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4aa88 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.825942:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4aa88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.825948:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071102b8e00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893024.825953:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4aa88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.825976:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4aa88 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.825988:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105cff300) 00010000:00010000:2.0:1787893024.825990:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787893024.825994:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4aa88 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893024.826001:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4aa88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893024.828675:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f57c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+26:10322:x1874741431401600:12345-192.168.202.29@tcp:54:lfs.0 Request processed in 2860us (11605us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893024.828689:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 49 00000100:00100000:3.0:1787893024.835580:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00010000:00010000:0.0:1787893024.842537:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893024.843194:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431401856 00000100:00100000:1.0:1787893024.843352:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431401856 00000100:00100000:1.0:1787893024.843456:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 11 00000100:00100000:1.0:1787893024.843466:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f57ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+26:10322:x1874741431401856:12345-192.168.202.29@tcp:35:lfs.0 00000100:00100000:1.0:1787893024.843716:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f57ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+27:10322:x1874741431401856:12345-192.168.202.29@tcp:35:lfs.0 Request processed in 251us (8147us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1787893024.843724:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 11 00000100:00100000:3.0:1787893025.242842:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893025.245349:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431402112 00000100:00100000:2.0:1787893025.245363:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431402112 00000100:00100000:2.0:1787893025.245454:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 50 00000100:00100000:2.0:1787893025.245468:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f57f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+27:10353:x1874741431402112:12345-192.168.202.29@tcp:101:cat.0 00010000:00010000:2.0:1787893025.245495:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893025.245527:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4aa8f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821af3a expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893025.245627:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4aa96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893025.245642:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4aa96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893025.245655:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4aa96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893025.245680:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787893025.245841:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4aa8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af3a expref: 30 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893025.245859:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4aa96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af3a expref: 29 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893025.245868:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105cff300) 00010000:00010000:2.0:1787893025.245871:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787893025.245874:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071102b9a00, rc 0) 00000100:00100000:2.0:1787893025.245947:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f57f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+29:10353:x1874741431402112:12345-192.168.202.29@tcp:101:cat.0 Request processed in 483us (3193us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1787893025.245954:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 50 00000100:00080000:1.0:1787893025.246610:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787893025.248931:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893025.250266:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893025.250345:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431402496 00000100:00100000:2.0:1787893025.250356:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431402496 00000100:00100000:2.0:1787893025.250422:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 12 00000100:00100000:2.0:1787893025.250433:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f57c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+29:10353:x1874741431402496:12345-192.168.202.29@tcp:35:cat.0 00000100:00100000:2.0:1787893025.250692:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f57c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+30:10353:x1874741431402496:12345-192.168.202.29@tcp:35:cat.0 Request processed in 259us (431us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1787893025.250699:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 12 00000100:00100000:0.0:1787893025.253397:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431402240 00000100:00100000:0.0:1787893025.253411:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431402240 00000100:00100000:0.0:1787893025.253550:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 3 00000100:00100000:0.0:1787893025.253561:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107fa7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4829748d-dde1-497a-9623-0e4326f0972c+30:2360:x1874741431402240:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893025.253579:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893025.253604:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4aa96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af3a expref: 30 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893025.253625:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105cff300) 00010000:00010000:0.0:1787893025.253629:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893025.253693:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107fa7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4829748d-dde1-497a-9623-0e4326f0972c+29:2360:x1874741431402240:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 133us (4771us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893025.253700:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 3 00000100:00100000:3.0:1787893025.360262:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893025.360334:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431402752 00000100:00100000:1.0:1787893025.360345:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431402752 00000100:00100000:1.0:1787893025.360413:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 51 00000100:00100000:1.0:1787893025.360424:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f57f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+29:10359:x1874741431402752:12345-192.168.202.29@tcp:101:dd.0 00010000:00010000:1.0:1787893025.360460:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893025.360464:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787893025.360492:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8600/0x825e3f5022b4a9fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af10 expref: 29 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893025.360521:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff907105cff400) 00010000:00010000:1.0:1787893025.360527:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787893025.360542:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4aaa4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821af41 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893025.360823:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4aaab lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893025.360838:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4aa7a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af33 expref: 29 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893025.360845:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4aaab lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893025.360892:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4aa7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af33 expref: 29 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893025.360907:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4aa7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af33 expref: 29 pid: 8281 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893025.360921:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f90c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1874741455550976:192.168.202.29@tcp:104: 00000100:00100000:1.0:1787893025.361017:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff90713f545600 going to sleep for 11 seconds 00000100:00100000:0.0:1787893025.364917:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f90c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1874741455550976:192.168.202.29@tcp:104: 00010000:00010000:0.0:1787893025.364950:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4aaab lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893025.365056:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893025.365134:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431402880 00000100:00100000:3.0:1787893025.365141:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431402880 00010000:00010000:3.0:1787893025.365175:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4aa7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af33 expref: 30 pid: 8281 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893025.365217:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 38 00000100:00100000:3.0:1787893025.365227:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f90c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4829748d-dde1-497a-9623-0e4326f0972c+30:2361:x1874741431402880:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787893025.365244:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893025.365251:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4aa7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af33 expref: 30 pid: 8281 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893025.365264:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4aa7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af33 expref: 30 pid: 8281 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893025.365299:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4aa7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af33 expref: 30 pid: 8281 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893025.365332:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105cff300) 00010000:00010000:3.0:1787893025.365337:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4aaab lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893025.365346:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4aaab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893025.365353:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4aaab lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893025.365382:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893025.365454:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f90c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4829748d-dde1-497a-9623-0e4326f0972c+29:2361:x1874741431402880:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 228us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893025.365462:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 38 00010000:00010000:0.0:1787893025.365730:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4aaab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893025.365738:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4aaab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893025.365796:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787893025.365981:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4aaa4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af41 expref: 30 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893025.366009:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4aaab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af41 expref: 29 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893025.366018:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105cff300) 00010000:00010000:0.0:1787893025.366021:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787893025.366023:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071421fb600, rc 0) 00000100:00100000:0.0:1787893025.366069:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f57f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+29:10359:x1874741431402752:12345-192.168.202.29@tcp:101:dd.0 Request processed in 5648us (5818us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1787893025.366077:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 51 00000100:00100000:1.0:1787893025.373128:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893025.375696:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431403136 00000100:00100000:2.0:1787893025.375713:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431403136 00000100:00100000:2.0:1787893025.375910:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 52 00000100:00100000:2.0:1787893025.375922:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f90df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+29:10359:x1874741431403136:12345-192.168.202.29@tcp:36:dd.0 00010000:00010000:2.0:1787893025.376186:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4aab9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893025.376230:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4aab9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893025.376242:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4aab9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787893025.376307:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967335 00000004:00010000:2.0:1787893025.376332:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004658870f reply state 0000000055b8becb transno 4294967336 ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4aab9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893025.376341:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787893025.376457:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f90df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+32:10359:x1874741431403136:12345-192.168.202.29@tcp:36:dd.0 Request processed in 536us (3340us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1787893025.376465:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 52 00000020:00080000:2.0:1787893025.376470:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787893025.379402:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4aab9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893025.379420:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4aab9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893025.379428:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4aab9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893025.379442:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071102b8e00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893025.379447:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4aab9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893025.379456:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4aab9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893025.379481:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105cff300) 00010000:00010000:1.0:1787893025.379484:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893025.379506:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4aab9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893025.379522:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4aab9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893025.481080:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f57ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455551488:0@lo:400:kworker.0 00000100:00100000:3.0:1787893025.481150:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893025.481215:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787893025.481221:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f57e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874741455551360:0@lo:400:kworker.0 00000100:00100000:3.0:1787893025.481248:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893025.481286:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455551360 00000100:00100000:3.0:1787893025.481293:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455551360 00000100:00100000:3.0:1787893025.481346:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787893025.481356:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f57e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874741455551360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893025.481419:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f57e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874741455551360:12345-0@lo:400:kworker.0 Request processed in 52us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893025.481426:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787893025.481466:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f57e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874741455551360:0@lo:400:kworker.0 00000100:00100000:0.0:1787893025.481638:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455551488 00000100:00100000:0.0:1787893025.481643:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455551488 00000100:00100000:0.0:1787893025.481683:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787893025.481690:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f57f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1874741455551488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893025.481726:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f57f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1874741455551488:12345-0@lo:400:kworker.0 Request processed in 38us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893025.481731:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787893025.481873:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f57ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455551488:0@lo:400:kworker.0 00000100:00100000:1.0:1787893025.482030:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f57fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22d910cf-711e-44e0-9acf-212404ada550:3307:1874741455551104:0@lo:400:kworker.0 00000100:00100000:1.0:1787893025.482068:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893025.482099:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f57d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874741455551616:0@lo:400:kworker.0 00000100:00100000:1.0:1787893025.482121:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893025.482136:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787893025.482141:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f57ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874741455551232:0@lo:400:kworker.0 00000100:00100000:1.0:1787893025.482160:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893025.482177:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f57c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455551744:0@lo:400:kworker.0 00000100:00100000:1.0:1787893025.482196:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893025.482218:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455551744 00000100:00100000:1.0:1787893025.482222:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455551744 00000100:00100000:1.0:1787893025.482255:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787893025.482262:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f90d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455551744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893025.482296:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f90d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455551744:12345-0@lo:400:kworker.0 Request processed in 35us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893025.482302:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:1.0:1787893025.482318:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787893025.482322:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787893025.482437:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f57c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455551744:0@lo:400:kworker.0 00000100:00100000:1.0:1787893025.482458:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455551616 00000100:00100000:1.0:1787893025.482461:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455551616 00000100:00100000:3.0:1787893025.482577:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455551104 00000100:00100000:3.0:1787893025.482581:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455551104 00000100:00100000:3.0:1787893025.482619:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1787893025.482626:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+19:3307:x1874741455551104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893025.482659:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a08850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+19:3307:x1874741455551104:12345-0@lo:400:kworker.0 Request processed in 34us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893025.482665:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1787893025.482836:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455551232 00000100:00100000:0.0:1787893025.482840:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455551232 00000100:00100000:0.0:1787893025.482872:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787893025.482879:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f90e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874741455551232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893025.482911:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f90e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874741455551232:12345-0@lo:400:kworker.0 Request processed in 33us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893025.482918:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:0.0:1787893025.482941:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787893025.482962:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f57ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874741455551232:0@lo:400:kworker.0 00000100:00100000:0.0:1787893025.482984:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f57fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22d910cf-711e-44e0-9acf-212404ada550:3307:1874741455551104:0@lo:400:kworker.0 00000100:00100000:1.0:1787893025.483151:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787893025.483166:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f90ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874741455551616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893025.483202:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f90ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874741455551616:12345-0@lo:400:kworker.0 Request processed in 37us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893025.483208:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787893025.483913:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f57d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874741455551616:0@lo:400:kworker.0 00000100:00100000:1.0:1787893025.768532:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893025.769168:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431403264 00000100:00100000:0.0:1787893025.769181:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431403264 00000100:00100000:0.0:1787893025.769290:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 53 00000100:00100000:0.0:1787893025.769301:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f90fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+31:10373:x1874741431403264:12345-192.168.202.29@tcp:101:stat.0 00010000:00010000:0.0:1787893025.769327:0:8281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893025.769350:0:8281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4aac0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821af48 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893025.769422:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9000/0x825e3f5022b4aac7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893025.769437:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9000/0x825e3f5022b4aac7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893025.769449:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9000/0x825e3f5022b4aac7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893025.769465:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4aace lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893025.769472:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4aace lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893025.769492:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4aace lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893025.769859:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4aad5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893025.769876:0:8281:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4aaab lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af41 expref: 32 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893025.769884:0:8281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4aad5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893025.769917:0:8281:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4aaab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af41 expref: 32 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893025.769932:0:8281:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4aaab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af41 expref: 32 pid: 5848 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893025.769945:0:8281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8281:1874741455551872:192.168.202.29@tcp:104: 00000100:00100000:0.0:1787893025.770068:0:8281:0:(client.c:2715:ptlrpc_set_wait()) set ffff907109145540 going to sleep for 11 seconds 00000100:00100000:1.0:1787893025.775312:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893025.775545:0:8281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8281:1874741455551872:192.168.202.29@tcp:104: 00000100:00100000:2.0:1787893025.775563:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431403520 00000100:00100000:2.0:1787893025.775571:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431403520 00010000:00010000:0.0:1787893025.775577:0:8281:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4aad5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893025.775637:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 13 00000100:00100000:2.0:1787893025.775647:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f90ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+33:5600:x1874741431403520:12345-192.168.202.29@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787893025.776013:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f90ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+34:5600:x1874741431403520:12345-192.168.202.29@tcp:35:ldlm_bl.0 Request processed in 365us (706us total) trans 4294967337 rc 0/0 00000100:00100000:2.0:1787893025.776022:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 13 00000100:00100000:3.0:1787893025.781948:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893025.783582:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431403648 00000100:00100000:1.0:1787893025.783599:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431403648 00010000:00010000:1.0:1787893025.783650:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4aaab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af41 expref: 34 pid: 5848 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893025.783698:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 39 00000100:00100000:1.0:1787893025.783707:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f57ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4829748d-dde1-497a-9623-0e4326f0972c+34:2361:x1874741431403648:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893025.783723:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893025.783731:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4aaab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af41 expref: 34 pid: 5848 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893025.783744:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4aaab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af41 expref: 34 pid: 5848 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893025.783803:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4aaab lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af41 expref: 34 pid: 5848 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893025.783825:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105cff300) 00010000:00010000:1.0:1787893025.783831:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4aad5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893025.783840:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4aad5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893025.783862:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4aad5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893025.783899:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893025.783969:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f57ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4829748d-dde1-497a-9623-0e4326f0972c+33:2361:x1874741431403648:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 262us (2029us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893025.783977:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 39 00010000:00010000:2.0:1787893025.784170:0:8281:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4aad5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893025.784179:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4aad5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893025.784238:0:8281:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787893025.784251:0:8281:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787893025.784300:0:8281:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4aad5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893025.784314:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4aad5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893025.784324:0:8281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9000/0x825e3f5022b4aac7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893025.784332:0:8281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9000/0x825e3f5022b4aac7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893025.784338:0:8281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9000/0x825e3f5022b4aac7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893025.784344:0:8281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc9000 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893025.784349:0:8281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9000/0x825e3f5022b4aac7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893025.784357:0:8281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9000/0x825e3f5022b4aac7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893025.784367:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff907105cff400) 00010000:00010000:2.0:1787893025.784370:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893025.784374:0:8281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9000/0x825e3f5022b4aac7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893025.784381:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9000/0x825e3f5022b4aac7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893025.784392:0:8281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4aace lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893025.784408:0:8281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4aace lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893025.784414:0:8281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4aace lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893025.784419:0:8281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc8400 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893025.784422:0:8281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4aace lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893025.784439:0:8281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4aace lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893025.784448:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9071061f7e00) 00010000:00010000:2.0:1787893025.784450:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893025.784453:0:8281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4aace lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893025.784460:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4aace lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893025.784493:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4aac0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af48 expref: 33 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893025.784518:0:8281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4aad5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af48 expref: 32 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893025.784526:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105cff300) 00010000:00010000:2.0:1787893025.784528:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787893025.784536:0:8281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907137fc8200, rc 0) 00000100:00100000:2.0:1787893025.784570:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f90fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+32:10373:x1874741431403264:12345-192.168.202.29@tcp:101:stat.0 Request processed in 15272us (16048us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893025.784578:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 53 00010000:00010000:1.0:1787893025.865018:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893025.889076:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893025.889192:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431403904 00000100:00100000:1.0:1787893025.889203:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431403904 00000100:00100000:1.0:1787893025.889268:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 54 00000100:00100000:1.0:1787893025.889278:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f57e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+32:10379:x1874741431403904:12345-192.168.202.29@tcp:36:truncate.0 00010000:00010000:1.0:1787893025.889339:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893025.889368:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4aad5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af48 expref: 32 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893025.889389:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105cff300) 00010000:00010000:1.0:1787893025.889394:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787893025.889863:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4aadc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893025.889877:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4aadc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893025.889886:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4aadc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787893025.889933:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967338 00000004:00010000:1.0:1787893025.889973:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009e7f8b36 reply state 000000002d333214 transno 4294967339 ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4aadc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893025.889981:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787893025.890100:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f57e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+34:10379:x1874741431403904:12345-192.168.202.29@tcp:36:truncate.0 Request processed in 823us (1034us total) trans 4294967339 rc 0/0 00000100:00100000:1.0:1787893025.890108:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 54 00000020:00080000:1.0:1787893025.890113:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787893025.897097:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4aadc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893025.897117:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4aadc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893025.897125:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4aadc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893025.897131:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fb600 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893025.897137:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4aadc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893025.897145:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4aadc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893025.897163:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105cff300) 00010000:00010000:1.0:1787893025.897166:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893025.897171:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4aadc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893025.897177:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4aadc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893025.993053:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787893025.993099:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f57d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455552000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787893025.993171:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893025.993351:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455552000 00000100:00100000:3.0:1787893025.993360:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455552000 00000100:00100000:3.0:1787893025.993413:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787893025.993423:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f90f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455552000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787893025.993466:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787893025.993534:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f90f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455552000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893025.993541:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787893025.993792:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f57d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455552000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787893026.110925:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893026.111325:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431404032 00000100:00100000:2.0:1787893026.111339:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431404032 00000100:00100000:2.0:1787893026.111492:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 55 00000100:00100000:2.0:1787893026.111515:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f57d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+33:10393:x1874741431404032:12345-192.168.202.29@tcp:101:stat.0 00010000:00010000:2.0:1787893026.111557:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893026.111591:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9000/0x825e3f5022b4aae3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821af4f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.111686:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9200/0x825e3f5022b4aaea lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.111704:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9200/0x825e3f5022b4aaea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.111718:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9200/0x825e3f5022b4aaea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.111736:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8400/0x825e3f5022b4aaf1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.111743:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8400/0x825e3f5022b4aaf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.111789:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8400/0x825e3f5022b4aaf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.112281:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4aaf8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.112291:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4aaf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.112298:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4aaf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893026.112344:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1787893026.112349:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787893026.112376:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4aaf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.112391:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4aaf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.112400:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9200/0x825e3f5022b4aaea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.112407:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9200/0x825e3f5022b4aaea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.112415:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9200/0x825e3f5022b4aaea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.112421:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071102b9200 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893026.112426:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9200/0x825e3f5022b4aaea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.112434:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9200/0x825e3f5022b4aaea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.112456:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff907105cff400) 00010000:00010000:2.0:1787893026.112460:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893026.112465:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9200/0x825e3f5022b4aaea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.112471:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9200/0x825e3f5022b4aaea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.112485:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8400/0x825e3f5022b4aaf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.112492:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8400/0x825e3f5022b4aaf1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.112497:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8400/0x825e3f5022b4aaf1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.112503:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071102b8400 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893026.112515:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8400/0x825e3f5022b4aaf1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.112522:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8400/0x825e3f5022b4aaf1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.112529:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff907105cfff00) 00010000:00010000:2.0:1787893026.112531:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893026.112534:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8400/0x825e3f5022b4aaf1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.112539:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8400/0x825e3f5022b4aaf1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.112589:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9000/0x825e3f5022b4aae3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af4f expref: 35 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.112605:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4aaf8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af4f expref: 34 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.112613:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105cff300) 00010000:00010000:2.0:1787893026.112615:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787893026.112617:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071102b9a00, rc 0) 00000100:00100000:2.0:1787893026.112717:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f57d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+34:10393:x1874741431404032:12345-192.168.202.29@tcp:101:stat.0 Request processed in 1213us (1807us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893026.112726:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 55 00000100:00100000:3.0:1787893026.164066:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893026.164255:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431404288 00000100:00100000:0.0:1787893026.164269:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431404288 00000100:00100000:0.0:1787893026.164426:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 56 00000100:00100000:0.0:1787893026.164438:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f57d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+34:10403:x1874741431404288:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:0.0:1787893026.164467:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893026.164517:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9200/0x825e3f5022b4aaff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821af56 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893026.164919:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1787893026.165154:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9200/0x825e3f5022b4aaff lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af56 expref: 36 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893026.165172:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907105907600) 00010000:00010000:0.0:1787893026.165176:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787893026.165182:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9200/0x825e3f5022b4aaff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af56 expref: 36 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893026.165197:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907137fc9200, rc 0) 00000100:00100000:0.0:1787893026.165327:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f57d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+35:10403:x1874741431404288:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 890us (1276us total) trans 4294967340 rc 301/301 00000100:00100000:0.0:1787893026.165336:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 56 00000100:00100000:0.0:1787893026.167828:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893026.167906:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431404544 00000100:00100000:2.0:1787893026.167919:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431404544 00000100:00100000:2.0:1787893026.167983:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 14 00000100:00100000:2.0:1787893026.167991:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+35:10403:x1874741431404544:12345-192.168.202.29@tcp:35:lfs.0 00000100:00100000:2.0:1787893026.169619:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+36:10403:x1874741431404544:12345-192.168.202.29@tcp:35:lfs.0 Request processed in 1613us (1796us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1787893026.169634:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 14 00000100:00100000:3.0:1787893026.232397:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893026.232553:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431404800 00000100:00100000:0.0:1787893026.232570:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431404800 00000100:00100000:0.0:1787893026.232659:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 57 00000100:00100000:0.0:1787893026.232671:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f57fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+36:10409:x1874741431404800:12345-192.168.202.29@tcp:101:bash.0 00010000:00010000:0.0:1787893026.232697:0:8281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893026.232719:0:8281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9200/0x825e3f5022b4ab0d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821af5d expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893026.232853:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4ab14 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893026.232867:0:8281:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4aaf8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af4f expref: 37 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893026.232874:0:8281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4ab14 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893026.232923:0:8281:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4aaf8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af4f expref: 37 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893026.232936:0:8281:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4aaf8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af4f expref: 37 pid: 5849 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893026.232950:0:8281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8281:1874741455552128:192.168.202.29@tcp:104: 00000100:00100000:0.0:1787893026.233079:0:8281:0:(client.c:2715:ptlrpc_set_wait()) set ffff907109145c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787893026.236499:0:8281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8281:1874741455552128:192.168.202.29@tcp:104: 00010000:00010000:0.0:1787893026.236628:0:8281:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4ab14 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893026.236692:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893026.237059:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431404928 00000100:00100000:1.0:1787893026.237068:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431404928 00010000:00010000:1.0:1787893026.237116:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4aaf8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af4f expref: 38 pid: 5849 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893026.237170:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 40 00000100:00100000:1.0:1787893026.237181:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f57ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4829748d-dde1-497a-9623-0e4326f0972c+38:2361:x1874741431404928:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893026.237198:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893026.237205:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4aaf8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af4f expref: 38 pid: 5849 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893026.237220:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4aaf8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af4f expref: 38 pid: 5849 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893026.237248:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4aaf8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af4f expref: 38 pid: 5849 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893026.237265:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105cff300) 00010000:00010000:1.0:1787893026.237270:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4ab14 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893026.237279:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4ab14 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893026.237355:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4ab14 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893026.237611:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893026.237678:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f57ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4829748d-dde1-497a-9623-0e4326f0972c+37:2361:x1874741431404928:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 497us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893026.237686:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 40 00010000:00010000:0.0:1787893026.238118:0:8281:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4ab14 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893026.238141:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4ab14 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893026.238165:0:8281:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1787893026.240203:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9200/0x825e3f5022b4ab0d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af5d expref: 38 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893026.240235:0:8281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4ab14 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af5d expref: 37 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893026.240244:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105cff300) 00010000:00010000:0.0:1787893026.240247:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787893026.240269:0:8281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907137fc8200, rc 0) 00000100:00100000:0.0:1787893026.242140:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f57fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+37:10409:x1874741431404800:12345-192.168.202.29@tcp:101:bash.0 Request processed in 9459us (9747us total) trans 4294967342 rc 0/0 00000100:00100000:0.0:1787893026.242155:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 57 00000100:00100000:3.0:1787893026.252291:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893026.252883:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431405184 00000100:00100000:1.0:1787893026.252898:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431405184 00000100:00100000:1.0:1787893026.252978:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 58 00000100:00100000:1.0:1787893026.252991:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f57c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+37:10409:x1874741431405184:12345-192.168.202.29@tcp:36:bash.0 00010000:00010000:1.0:1787893026.254155:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4ab22 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893026.254185:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4ab22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893026.254200:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4ab22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787893026.254439:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967343 00000004:00010000:1.0:1787893026.254597:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000123fd0b4 reply state 00000000724474a1 transno 4294967344 ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4ab22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893026.254610:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787893026.254833:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f57c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+40:10409:x1874741431405184:12345-192.168.202.29@tcp:36:bash.0 Request processed in 1840us (2555us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1787893026.254843:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 58 00000020:00080000:1.0:1787893026.254850:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787893026.264748:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893026.265501:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431405312 00000100:00100000:3.0:1787893026.265529:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431405312 00000100:00100000:3.0:1787893026.265617:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 59 00000100:00100000:3.0:1787893026.265630:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907108386680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+40:10409:x1874741431405312:12345-192.168.202.29@tcp:101:bash.0 00010000:00010000:3.0:1787893026.265693:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893026.265727:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4ab29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821af64 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893026.265889:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4ab30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893026.265908:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4ab14 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af5d expref: 41 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893026.265916:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4ab22 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893026.265924:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4ab30 lrc: 5/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893026.265945:0:5849:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4ab22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893026.266119:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4ab14 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af5d expref: 41 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893026.266139:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4ab14 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af5d expref: 41 pid: 8281 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893026.266158:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90710838b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1874741455552256:192.168.202.29@tcp:104: 00000100:00100000:3.0:1787893026.266403:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff907139cdecc0 going to sleep for 11 seconds 00010000:00010000:1.0:1787893026.269028:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4ab22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893026.269085:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4ab22 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893026.269094:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4ab22 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893026.269101:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fb600 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893026.269108:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4ab22 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893026.269118:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4ab22 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893026.269144:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105cff300) 00010000:00010000:1.0:1787893026.269148:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893026.269153:0:3291:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4ab30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893026.269166:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4ab22 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893026.269172:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4ab22 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893026.271112:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893026.271238:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431405440 00000100:00100000:1.0:1787893026.271258:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431405440 00010000:00010000:1.0:1787893026.271308:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4ab14 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af5d expref: 41 pid: 8281 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893026.271350:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 41 00000100:00100000:1.0:1787893026.271362:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907108386a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4829748d-dde1-497a-9623-0e4326f0972c+41:2361:x1874741431405440:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893026.271396:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893026.271405:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4ab14 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af5d expref: 41 pid: 8281 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893026.271421:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4ab14 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af5d expref: 41 pid: 8281 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893026.271447:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105cff300) 00010000:00010000:1.0:1787893026.271454:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4ab30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893026.271464:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4ab30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893026.271482:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4ab30 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893026.271514:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893026.271587:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907108386a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4829748d-dde1-497a-9623-0e4326f0972c+41:2361:x1874741431405440:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 228us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893026.271593:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 41 00010000:00010000:3.0:1787893026.272347:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4ab14 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af5d expref: 40 pid: 8281 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893026.272393:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90710838b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1874741455552256:192.168.202.29@tcp:104: 00010000:00010000:3.0:1787893026.272425:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4ab30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893026.272435:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4ab30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893026.272440:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4ab30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893026.272582:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787893026.272588:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787893026.272625:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4ab30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893026.273448:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4ab29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af64 expref: 40 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893026.273475:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4ab30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af64 expref: 39 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893026.273485:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105cff300) 00010000:00010000:3.0:1787893026.273488:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787893026.273491:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907104f47800, rc 0) 00000100:00100000:2.0:1787893026.273727:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907108386680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+39:10409:x1874741431405312:12345-192.168.202.29@tcp:101:bash.0 Request processed in 8098us (8994us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893026.273735:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 59 00000100:00100000:2.0:1787893026.278009:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893026.278174:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431405696 00000100:00100000:1.0:1787893026.278188:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431405696 00000100:00100000:1.0:1787893026.278268:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 15 00000100:00100000:1.0:1787893026.278280:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713044d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+39:10409:x1874741431405696:12345-192.168.202.29@tcp:35:bash.0 00000100:00100000:1.0:1787893026.278869:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713044d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+40:10409:x1874741431405696:12345-192.168.202.29@tcp:35:bash.0 Request processed in 366us (662us total) trans 4294967345 rc 0/0 00000100:00100000:1.0:1787893026.278881:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 15 00000100:00100000:2.0:1787893026.361574:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893026.361792:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431405952 00000100:00100000:0.0:1787893026.361807:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431405952 00000100:00100000:0.0:1787893026.361957:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 60 00000100:00100000:0.0:1787893026.361970:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907108385180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+40:10419:x1874741431405952:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:0.0:1787893026.362014:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893026.362048:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9200/0x825e3f5022b4ab37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821af6b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893026.362519:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1787893026.362738:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9200/0x825e3f5022b4ab37 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af6b expref: 42 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893026.362810:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907105907600) 00010000:00010000:0.0:1787893026.362814:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787893026.362820:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9200/0x825e3f5022b4ab37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af6b expref: 42 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893026.362837:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907137fc9200, rc 0) 00000100:00100000:0.0:1787893026.362912:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907108385180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+41:10419:x1874741431405952:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 945us (1353us total) trans 4294967346 rc 301/301 00000100:00100000:0.0:1787893026.362921:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 60 00000100:00100000:3.0:1787893026.367154:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893026.367329:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431406080 00000100:00100000:0.0:1787893026.367343:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431406080 00000100:00100000:0.0:1787893026.367487:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 61 00000100:00100000:0.0:1787893026.367531:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710838b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+41:10419:x1874741431406080:12345-192.168.202.29@tcp:34:lfs.0 00010000:00010000:0.0:1787893026.367640:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9c00/0x825e3f5022b4ab45 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893026.367673:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9c00/0x825e3f5022b4ab45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893026.367688:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9c00/0x825e3f5022b4ab45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893026.367706:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4ab4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893026.367715:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4ab4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893026.367722:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4ab4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893026.368166:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4ab53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893026.368178:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4ab53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893026.368185:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4ab53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787893026.368240:0:8281:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4ab53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893026.368268:0:8281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9c00/0x825e3f5022b4ab45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893026.368282:0:8281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9c00/0x825e3f5022b4ab45 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893026.368291:0:8281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9c00/0x825e3f5022b4ab45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893026.368298:0:8281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc9c00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:0.0:1787893026.368304:0:8281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9c00/0x825e3f5022b4ab45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893026.368313:0:8281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9c00/0x825e3f5022b4ab45 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893026.368329:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff907105cff400) 00010000:00010000:0.0:1787893026.368332:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893026.368338:0:8281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9c00/0x825e3f5022b4ab45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893026.368344:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9c00/0x825e3f5022b4ab45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893026.368359:0:8281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4ab4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893026.368366:0:8281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4ab4c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893026.368372:0:8281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4ab4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893026.368377:0:8281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc9800 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:0.0:1787893026.368388:0:8281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4ab4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893026.368395:0:8281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4ab4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893026.368404:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9071061f7500) 00010000:00010000:0.0:1787893026.368406:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893026.368409:0:8281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4ab4c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893026.368414:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4ab4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893026.368429:0:8281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4ab53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893026.368435:0:8281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4ab53 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893026.368440:0:8281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4ab53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893026.368445:0:8281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc8400 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:0.0:1787893026.368448:0:8281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4ab53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893026.368454:0:8281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4ab53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893026.368462:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105cff300) 00010000:00010000:0.0:1787893026.368463:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893026.368472:0:8281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4ab53 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893026.368478:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4ab53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893026.368600:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710838b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+41:10419:x1874741431406080:12345-192.168.202.29@tcp:34:lfs.0 Request processed in 1069us (1462us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893026.368610:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 61 00000100:00100000:3.0:1787893026.372054:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893026.372221:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431406336 00000100:00100000:1.0:1787893026.372236:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431406336 00000100:00100000:1.0:1787893026.372327:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 16 00000100:00100000:1.0:1787893026.372339:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907108389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+41:10419:x1874741431406336:12345-192.168.202.29@tcp:35:lfs.0 00000100:00100000:1.0:1787893026.375204:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907108389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+42:10419:x1874741431406336:12345-192.168.202.29@tcp:35:lfs.0 Request processed in 2850us (3150us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1787893026.375220:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 16 00000100:00100000:3.0:1787893026.425338:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893026.425531:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431406592 00000100:00100000:1.0:1787893026.425545:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431406592 00000100:00100000:1.0:1787893026.425623:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 62 00000100:00100000:1.0:1787893026.425634:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907108389f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+42:10422:x1874741431406592:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:1.0:1787893026.425680:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893026.425705:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4ab5a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821af72 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893026.425850:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4ab61 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893026.425866:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4ab61 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893026.425879:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4ab61 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893026.425897:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4ab68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893026.425904:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4ab68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893026.425934:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4ab68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893026.427248:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4ab6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893026.427266:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4ab6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893026.427277:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4ab6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893026.427289:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787893026.427410:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4ab61 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893026.427419:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4ab61 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893026.427427:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4ab61 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893026.427433:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fa000 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893026.427439:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4ab61 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893026.427448:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4ab61 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893026.427462:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff907105cff400) 00010000:00010000:1.0:1787893026.427465:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893026.427560:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4ab61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893026.427568:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4ab61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893026.427589:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4ab68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893026.427595:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4ab68 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893026.427602:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4ab68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893026.427607:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fb400 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893026.427610:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4ab68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893026.427615:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4ab68 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893026.427623:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff907105907d00) 00010000:00010000:1.0:1787893026.427625:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893026.427628:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4ab68 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893026.427633:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4ab68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893026.428094:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4ab5a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af72 expref: 45 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893026.428129:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4ab6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af72 expref: 44 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893026.428137:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105cff300) 00010000:00010000:1.0:1787893026.428140:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787893026.428142:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071421fa400, rc 0) 00000100:00100000:1.0:1787893026.428247:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907108389f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+44:10422:x1874741431406592:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 2612us (2923us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1787893026.428258:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 62 00000100:00100000:3.0:1787893026.433377:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893026.433457:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893026.433613:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431406720 00000100:00100000:2.0:1787893026.433627:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431406720 00000100:00100000:2.0:1787893026.433718:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 63 00000100:00100000:2.0:1787893026.433731:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907108388a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+44:10422:x1874741431406720:12345-192.168.202.29@tcp:54:lfs.0 00010000:00010000:2.0:1787893026.433853:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9200/0x825e3f5022b4ab7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.433875:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9200/0x825e3f5022b4ab7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.433889:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9200/0x825e3f5022b4ab7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.433925:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9200/0x825e3f5022b4ab7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.433933:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9200/0x825e3f5022b4ab7d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.433940:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9200/0x825e3f5022b4ab7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.433947:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071102b9200 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893026.433952:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9200/0x825e3f5022b4ab7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.433960:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9200/0x825e3f5022b4ab7d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.433974:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105cff300) 00010000:00010000:2.0:1787893026.433977:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787893026.433993:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9200/0x825e3f5022b4ab7d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.433999:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9200/0x825e3f5022b4ab7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893026.434293:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907108388a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+44:10422:x1874741431406720:12345-192.168.202.29@tcp:54:lfs.0 Request processed in 562us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893026.434303:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 63 00000100:00100000:1.0:1787893026.435312:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431406848 00000100:00100000:1.0:1787893026.435326:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431406848 00000100:00100000:1.0:1787893026.435399:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 4 00000100:00100000:1.0:1787893026.435409:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907108388700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4829748d-dde1-497a-9623-0e4326f0972c+44:2361:x1874741431406848:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893026.435427:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893026.435454:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4ab6f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af72 expref: 44 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893026.435488:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105cff300) 00010000:00010000:1.0:1787893026.435494:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893026.435559:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907108388700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4829748d-dde1-497a-9623-0e4326f0972c+43:2361:x1874741431406848:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 151us (2100us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893026.435566:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 4 00000100:00100000:3.0:1787893026.439714:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893026.440142:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431407104 00000100:00100000:2.0:1787893026.440156:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431407104 00000100:00100000:2.0:1787893026.440224:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 17 00000100:00100000:2.0:1787893026.440236:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710838ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+43:10422:x1874741431407104:12345-192.168.202.29@tcp:35:lfs.0 00000100:00100000:2.0:1787893026.440565:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710838ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+44:10422:x1874741431407104:12345-192.168.202.29@tcp:35:lfs.0 Request processed in 329us (867us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1787893026.440575:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 17 00000100:00100000:2.0:1787893026.582671:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893026.582901:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431407360 00000100:00100000:0.0:1787893026.582915:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431407360 00000100:00100000:0.0:1787893026.583010:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 64 00000100:00100000:0.0:1787893026.583023:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907108385880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+44:10440:x1874741431407360:12345-192.168.202.29@tcp:101:cat.0 00010000:00010000:0.0:1787893026.583059:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893026.583089:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4ab84 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821af79 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893026.583238:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9c00/0x825e3f5022b4ab8b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893026.583258:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9c00/0x825e3f5022b4ab8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893026.583272:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9c00/0x825e3f5022b4ab8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893026.583284:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787893026.583459:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4ab84 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af79 expref: 47 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893026.583483:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9c00/0x825e3f5022b4ab8b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af79 expref: 46 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893026.583533:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105cff300) 00010000:00010000:0.0:1787893026.583536:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787893026.583540:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907137fc9c00, rc 0) 00000100:00100000:0.0:1787893026.583625:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907108385880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+46:10440:x1874741431407360:12345-192.168.202.29@tcp:101:cat.0 Request processed in 603us (981us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1787893026.583635:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 64 00000100:00100000:0.0:1787893026.613535:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893026.613801:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431407488 00000100:00100000:2.0:1787893026.613817:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431407488 00000100:00100000:2.0:1787893026.613900:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 65 00000100:00100000:2.0:1787893026.613914:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+46:10441:x1874741431407488:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:2.0:1787893026.613946:0:8281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893026.613974:0:8281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9200/0x825e3f5022b4ab99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821af80 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.614072:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9000/0x825e3f5022b4aba0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.614089:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9000/0x825e3f5022b4aba0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.614123:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9000/0x825e3f5022b4aba0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893026.614373:0:8281:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787893026.614378:0:8281:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787893026.614460:0:8281:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9000/0x825e3f5022b4aba0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.614518:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9200/0x825e3f5022b4ab99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af80 expref: 48 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.614540:0:8281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9000/0x825e3f5022b4aba0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af80 expref: 47 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.614551:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff907105cff400) 00010000:00010000:2.0:1787893026.614554:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787893026.614559:0:8281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071102b9000, rc 0) 00000100:00100000:2.0:1787893026.614653:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+47:10441:x1874741431407488:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 742us (1134us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893026.614661:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 65 00000100:00100000:3.0:1787893026.621620:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893026.622162:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431407872 00000100:00100000:2.0:1787893026.622176:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431407872 00000100:00100000:2.0:1787893026.622309:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 18 00000100:00100000:2.0:1787893026.622322:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710838b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+47:10441:x1874741431407872:12345-192.168.202.29@tcp:35:lfs.0 00000100:00100000:2.0:1787893026.623134:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710838b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+48:10441:x1874741431407872:12345-192.168.202.29@tcp:35:lfs.0 Request processed in 809us (1527us total) trans 4294967351 rc 0/0 00000100:00100000:2.0:1787893026.623145:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 18 00000100:00100000:3.0:1787893026.626581:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893026.626894:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431408000 00000100:00100000:1.0:1787893026.626909:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431408000 00000100:00100000:1.0:1787893026.627109:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 5 00000100:00100000:1.0:1787893026.627143:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907108388000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4829748d-dde1-497a-9623-0e4326f0972c+48:10441:x1874741431408000:12345-192.168.202.29@tcp:103:lfs.0 00010000:00010000:1.0:1787893026.627164:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787893026.627201:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4ab30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af64 expref: 48 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893026.627231:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9c00/0x825e3f5022b4ab8b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af79 expref: 47 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893026.627243:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9600/0x825e3f5022b4aa3b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af25 expref: 46 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893026.627257:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105cff300) 00010000:00010000:1.0:1787893026.627270:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893026.627350:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907108388000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4829748d-dde1-497a-9623-0e4326f0972c+45:10441:x1874741431408000:12345-192.168.202.29@tcp:103:lfs.0 Request processed in 211us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893026.627359:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 5 00000100:00100000:3.0:1787893026.629871:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893026.630145:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431408128 00000100:00100000:2.0:1787893026.630158:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431408128 00000100:00100000:2.0:1787893026.630232:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 66 00000100:00100000:2.0:1787893026.630244:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710838b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+45:10441:x1874741431408128:12345-192.168.202.29@tcp:58:lfs.0 00010000:00010000:2.0:1787893026.630418:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9200/0x825e3f5022b4aba7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.630440:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9200/0x825e3f5022b4aba7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.630454:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9200/0x825e3f5022b4aba7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787893026.630907:0:5848:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787893026.631242:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1787893026.631321:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1787893026.631459:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710838b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+45:10441:x1874741431408128:12345-192.168.202.29@tcp:58:lfs.0 Request processed in 1211us (1598us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893026.631471:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 66 00000100:00100000:3.0:1787893026.657061:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893026.657248:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431408256 00000100:00100000:2.0:1787893026.657261:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431408256 00000100:00100000:2.0:1787893026.657343:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 67 00000100:00100000:2.0:1787893026.657355:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710838bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+45:10443:x1874741431408256:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:2.0:1787893026.657383:0:8281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893026.657413:0:8281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4abae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821af87 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.657522:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9600/0x825e3f5022b4abb5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.657563:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9600/0x825e3f5022b4abb5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.657578:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9600/0x825e3f5022b4abb5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.657599:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8400/0x825e3f5022b4abbc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.657606:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8400/0x825e3f5022b4abbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.657613:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8400/0x825e3f5022b4abbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.658250:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4abc3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.658262:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4abc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.658270:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4abc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893026.658318:0:8281:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787893026.658323:0:8281:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787893026.658347:0:8281:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4abc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.658362:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4abc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.658384:0:8281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9600/0x825e3f5022b4abb5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.658391:0:8281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9600/0x825e3f5022b4abb5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.658399:0:8281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9600/0x825e3f5022b4abb5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.658407:0:8281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071102b9600 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893026.658413:0:8281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9600/0x825e3f5022b4abb5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.658422:0:8281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9600/0x825e3f5022b4abb5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.658437:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff907105cff400) 00010000:00010000:2.0:1787893026.658440:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893026.658446:0:8281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9600/0x825e3f5022b4abb5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.658453:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9600/0x825e3f5022b4abb5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.658468:0:8281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8400/0x825e3f5022b4abbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.658475:0:8281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8400/0x825e3f5022b4abbc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.658481:0:8281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8400/0x825e3f5022b4abbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.658493:0:8281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071102b8400 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893026.658496:0:8281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8400/0x825e3f5022b4abbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.658514:0:8281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8400/0x825e3f5022b4abbc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.658523:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff907105cffe00) 00010000:00010000:2.0:1787893026.658526:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893026.658529:0:8281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8400/0x825e3f5022b4abbc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.658535:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8400/0x825e3f5022b4abbc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.658577:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4abae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af87 expref: 47 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.658594:0:8281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4abc3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af87 expref: 46 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893026.658602:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105cfff00) 00010000:00010000:2.0:1787893026.658604:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787893026.658607:0:8281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071102b8e00, rc 0) 00000100:00100000:2.0:1787893026.658710:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710838bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+46:10443:x1874741431408256:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 1355us (1665us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893026.658718:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 67 00010000:00010000:1.0:1787893026.895173:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787893027.145977:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787893027.145987:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787893027.146032:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787893027.146059:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787893027.146305:0:11693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c3480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1874741455552384:192.168.202.29@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787893027.146405:0:11693:0:(client.c:2715:ptlrpc_set_wait()) set ffff907109145a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787893027.170735:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893027.170791:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431408384 00000100:00100000:0.0:1787893027.170799:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431408384 00000100:00100000:0.0:1787893027.170854:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1 00000100:00100000:0.0:1787893027.170865:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4829748d-dde1-497a-9623-0e4326f0972c+47:10454:x1874741431408384:12345-192.168.202.29@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1787893027.170946:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4829748d-dde1-497a-9623-0e4326f0972c+47:10454:x1874741431408384:12345-192.168.202.29@tcp:900:lhsmtool_posix.0 Request processed in 83us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893027.170953:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1 00000100:00080000:0.0:1787893027.170973:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787893027.171136:0:11693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c3480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1874741455552384:192.168.202.29@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787893027.187864:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893027.191933:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431408512 00000100:00100000:3.0:1787893027.191953:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431408512 00000100:00100000:3.0:1787893027.192028:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 68 00000100:00100000:3.0:1787893027.192039:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+46:10454:x1874741431408512:12345-192.168.202.29@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787893027.192071:0:5848:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787893027.192196:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+46:10454:x1874741431408512:12345-192.168.202.29@tcp:53:lhsmtool_posix.0 Request processed in 157us (4344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893027.192203:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 68 00000100:00100000:0.0:1787893027.196408:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893027.196608:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431408640 00000100:00100000:1.0:1787893027.196619:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431408640 00000100:00100000:1.0:1787893027.196685:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 69 00000100:00100000:1.0:1787893027.196696:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e5c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+46:10454:x1874741431408640:12345-192.168.202.29@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787893027.196941:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4abca lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.196959:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4abca lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.196985:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4abca lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.197001:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4abd1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.197007:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4abd1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.197014:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4abd1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.197038:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4abd8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.197047:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4abd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.197053:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4abd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893027.197090:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787893027.197095:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787893027.197110:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4abd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.197121:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4abca lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.197127:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4abca lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.197144:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4abca lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.197151:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fa400 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893027.197157:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4abca lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.197165:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4abca lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.197178:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9071061f7700) 00010000:00010000:1.0:1787893027.197182:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893027.197186:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4abca lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.197192:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4abca lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.197208:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4abd1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.197214:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4abd1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.197219:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4abd1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.197224:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fb600 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893027.197227:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4abd1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.197241:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4abd1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.197249:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff907105907d00) 00010000:00010000:1.0:1787893027.197251:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893027.197254:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4abd1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.197260:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4abd1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.197274:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4abd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.197280:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4abd8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.197285:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4abd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.197290:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fb400 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893027.197293:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4abd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.197299:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4abd8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.197305:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105cfff00) 00010000:00010000:1.0:1787893027.197307:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893027.197309:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4abd8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.197322:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4abd8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893027.197447:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e5c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+46:10454:x1874741431408640:12345-192.168.202.29@tcp:34:lhsmtool_posix.0 Request processed in 751us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893027.197455:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 69 00000100:00100000:0.0:1787893027.211378:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893027.211539:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431408896 00000100:00100000:3.0:1787893027.211549:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431408896 00000100:00100000:3.0:1787893027.211601:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 70 00000100:00100000:3.0:1787893027.211611:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105afbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+46:10454:x1874741431408896:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787893027.211633:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893027.211653:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4abdf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821af8e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893027.211748:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4abe6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893027.211787:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4abe6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893027.211810:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4abe6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893027.211835:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787893027.211931:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4abe6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893027.211940:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4abe6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893027.211946:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4abe6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893027.211953:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f47600 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893027.211957:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4abe6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893027.211964:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4abe6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893027.211977:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105cfff00) 00010000:00010000:3.0:1787893027.211980:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787893027.211985:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4abe6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893027.211992:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4abe6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893027.212034:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4abdf lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af8e expref: 48 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893027.212056:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9071061f7700) 00010000:00010000:3.0:1787893027.212059:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787893027.212063:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4abdf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af8e expref: 48 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893027.212073:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907104f47200, rc 0) 00000100:00100000:3.0:1787893027.212135:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105afbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+47:10454:x1874741431408896:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 Request processed in 524us (768us total) trans 4294967352 rc 301/301 00000100:00100000:3.0:1787893027.212142:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 70 00000100:00100000:0.0:1787893027.230104:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893027.230473:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431409024 00000100:00100000:2.0:1787893027.230490:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431409024 00000100:00100000:2.0:1787893027.230557:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 71 00000100:00100000:2.0:1787893027.230576:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+47:10454:x1874741431409024:12345-192.168.202.29@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787893027.230612:0:8281:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787893027.230734:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+47:10454:x1874741431409024:12345-192.168.202.29@tcp:53:lhsmtool_posix.0 Request processed in 167us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893027.230742:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 71 00000100:00100000:0.0:1787893027.239041:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893027.239938:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431409280 00000100:00100000:2.0:1787893027.239951:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431409280 00000100:00100000:2.0:1787893027.240017:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 72 00000100:00100000:2.0:1787893027.240028:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+47:10454:x1874741431409280:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787893027.240048:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893027.240052:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787893027.240081:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9000/0x825e3f5022b4aba0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af80 expref: 47 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.240102:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff907105cff400) 00010000:00010000:2.0:1787893027.240106:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787893027.240120:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9600/0x825e3f5022b4abf4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821af95 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787893027.240794:0:5848:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1787893027.248633:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8400/0x825e3f5022b4abfb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.248659:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8400/0x825e3f5022b4abfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.248688:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8400/0x825e3f5022b4abfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.248792:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9600/0x825e3f5022b4abf4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af95 expref: 49 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.248960:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8400/0x825e3f5022b4abfb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af95 expref: 48 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.248970:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff907105cffe00) 00010000:00010000:2.0:1787893027.248973:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787893027.248977:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071102b8400, rc 0) 00000100:00100000:2.0:1787893027.249053:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+48:10454:x1874741431409280:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 Request processed in 9026us (10019us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1787893027.249062:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 72 00000100:00100000:0.0:1787893027.253552:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893027.253853:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431409536 00000100:00100000:2.0:1787893027.253863:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431409536 00000100:00100000:2.0:1787893027.253915:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 73 00000100:00100000:2.0:1787893027.253925:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e62bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+48:10454:x1874741431409536:12345-192.168.202.29@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787893027.253979:0:8281:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893027.254005:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8400/0x825e3f5022b4abfb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af95 expref: 48 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.254023:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff907105cffe00) 00010000:00010000:2.0:1787893027.254033:0:8281:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787893027.254054:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4ac09 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.254076:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4ac09 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.254086:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4ac09 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.254154:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4ac10 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x41e16149 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.254164:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4ac10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x41e16149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.254172:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4ac10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x41e16149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.254448:0:8281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4ac09 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.254457:0:8281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4ac09 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.254464:0:8281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4ac09 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.254470:0:8281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071102b9a00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893027.254474:0:8281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4ac09 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.254481:0:8281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4ac09 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.254490:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff907105cff400) 00010000:00010000:2.0:1787893027.254511:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893027.254516:0:8281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4ac09 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.254523:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9a00/0x825e3f5022b4ac09 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.254533:0:8281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4ac10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x41e16149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.254538:0:8281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4ac10 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x41e16149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.254545:0:8281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4ac10 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x41e16149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.254550:0:8281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9ee00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893027.254553:0:8281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4ac10 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x41e16149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.254559:0:8281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4ac10 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x41e16149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.254566:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x41e16149 (ffff907105cff700) 00010000:00010000:2.0:1787893027.254568:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893027.254571:0:8281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4ac10 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x41e16149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.254575:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4ac10 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x41e16149 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893027.254656:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e62bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+47:10454:x1874741431409536:12345-192.168.202.29@tcp:36:lhsmtool_posix.0 Request processed in 731us (1113us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787893027.254669:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 73 00000100:00100000:1.0:1787893027.265126:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893027.265301:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431409664 00000100:00100000:0.0:1787893027.265312:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431409664 00000100:00100000:0.0:1787893027.265375:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 74 00000100:00100000:0.0:1787893027.265396:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f90ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+47:10454:x1874741431409664:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787893027.265416:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893027.265440:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4ac17 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821af9c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893027.265472:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9400/0x825e3f5022b4ac1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893027.265484:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9400/0x825e3f5022b4ac1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893027.265505:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9400/0x825e3f5022b4ac1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893027.265597:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4ac17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af9c expref: 49 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893027.265614:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9400/0x825e3f5022b4ac1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af9c expref: 48 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893027.265622:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9071061f7f00) 00010000:00010000:0.0:1787893027.265624:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787893027.265627:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907137fc9400, rc 0) 00000100:00100000:0.0:1787893027.265690:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f90ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+48:10454:x1874741431409664:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 Request processed in 297us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893027.265698:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 74 00000100:00100000:0.0:1787893027.268077:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893027.268143:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431409920 00000100:00100000:2.0:1787893027.268152:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431409920 00000100:00100000:2.0:1787893027.268209:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 75 00000100:00100000:2.0:1787893027.268219:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e62b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+48:10454:x1874741431409920:12345-192.168.202.29@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787893027.268295:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4ac25 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.268310:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4ac25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.268321:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4ac25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787893027.268689:0:8281:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:2.0:1787893027.268700:0:8281:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 355035946624ns, next at 356035944420ns, rc = 0 00000004:00010000:2.0:1787893027.268811:0:8281:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004369279d reply state 0000000081b3224d transno 4294967354 ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4ac25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893027.269360:0:8281:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787893027.269692:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e62b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+50:10454:x1874741431409920:12345-192.168.202.29@tcp:36:lhsmtool_posix.0 Request processed in 1471us (1621us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1787893027.269700:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 75 00010000:00010000:1.0:1787893027.277136:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4ac25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.277155:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4ac25 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.277163:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4ac25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.277169:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9ee00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893027.277175:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4ac25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.277183:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4ac25 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.277201:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9071061f7f00) 00010000:00010000:1.0:1787893027.277204:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787893027.277207:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4ac25 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.277213:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4ac25 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893027.277429:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893027.285777:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431410048 00000100:00100000:3.0:1787893027.285803:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431410048 00000100:00100000:3.0:1787893027.285890:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 76 00000100:00100000:3.0:1787893027.285903:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107e81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+49:10454:x1874741431410048:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787893027.285938:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893027.285969:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4ac2c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821afa3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893027.286059:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4ac2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afa3 expref: 50 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893027.286079:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4ac2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afa3 expref: 50 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893027.286103:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9071061f7f00) 00010000:00010000:3.0:1787893027.286107:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787893027.286132:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907104f47600, rc 0) 00000100:00100000:3.0:1787893027.286233:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107e81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+50:10454:x1874741431410048:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 Request processed in 332us (8807us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893027.286241:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 76 00000100:00100000:1.0:1787893027.302916:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893027.303227:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431410176 00000100:00100000:2.0:1787893027.303237:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431410176 00000100:00100000:2.0:1787893027.303284:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 24 00000100:00100000:2.0:1787893027.303293:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f57ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2359:x1874741431410176:12345-192.168.202.29@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1787893027.303327:0:6702:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 4829748d-dde1-497a-9623-0e4326f0972c@192.168.202.29@tcp t0 exp 0000000000000000 cur 355 last 0 00000020:00000080:2.0:1787893027.303371:0:6702:0:(genops.c:1385:class_connect()) connect: client 4829748d-dde1-497a-9623-0e4326f0972c, cookie 0x825e3f5022b4ac33 00002000:00100000:2.0:1787893027.303395:0:6702:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4829748d-dde1-497a-9623-0e4326f0972c/ffff9071184b6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787893027.303418:0:6702:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787893027.303677:0:6702:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787893027.303706:0:6702:0:(import.c:65:import_set_state_nolock()) ffff9071184b3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787893027.303823:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f57ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4829748d-dde1-497a-9623-0e4326f0972c+6:2359:x1874741431410176:12345-192.168.202.29@tcp:8:lhsmtool_posix.0 Request processed in 515us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893027.303832:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 24 00000100:00100000:2.0:1787893027.310141:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893027.315853:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431410304 00000100:00100000:1.0:1787893027.315880:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431410304 00000100:00100000:1.0:1787893027.316002:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 25 00000100:00080000:2.0:1787893027.316003:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787893027.316025:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907108385500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4829748d-dde1-497a-9623-0e4326f0972c+6:0:x1874741431410304:12345-192.168.202.29@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787893027.403116:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907108385500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4829748d-dde1-497a-9623-0e4326f0972c+7:0:x1874741431410304:12345-192.168.202.29@tcp:2:lhsmtool_posix.0 Request processed in 87082us (92965us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787893027.403134:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 25 00000001:00080000:0.0:1787893027.403189:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:0.0:1787893027.403213:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4829748d-dde1-497a-9623-0e4326f0972c 00000100:00100000:3.0:1787893027.411923:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893027.413305:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431410560 00000100:00100000:1.0:1787893027.413320:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431410560 00000100:00100000:1.0:1787893027.413387:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 19 00000100:00100000:1.0:1787893027.413400:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907108388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+50:10454:x1874741431410560:12345-192.168.202.29@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787893027.413687:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907108388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+51:10454:x1874741431410560:12345-192.168.202.29@tcp:35:lhsmtool_posix.0 Request processed in 289us (1776us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1787893027.413694:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 19 00000100:00100000:1.0:1787893027.428388:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893027.428480:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431410816 00000100:00100000:2.0:1787893027.428511:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431410816 00000100:00100000:2.0:1787893027.428604:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 77 00000100:00100000:2.0:1787893027.428617:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f57ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+51:10454:x1874741431410816:12345-192.168.202.29@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787893027.428813:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f57ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+51:10454:x1874741431410816:12345-192.168.202.29@tcp:57:lhsmtool_posix.0 Request processed in 195us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893027.428822:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 77 00000100:00100000:3.0:1787893027.431853:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893027.431960:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431410944 00000100:00100000:1.0:1787893027.431973:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431410944 00000100:00100000:1.0:1787893027.432042:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 78 00000100:00100000:1.0:1787893027.432054:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710838a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+51:10454:x1874741431410944:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787893027.432076:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893027.432099:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4ac3a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821afaa expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.432183:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4ac41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.432197:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4ac41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.432224:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4ac41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893027.432265:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787893027.432284:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4ac41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.432311:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4ac3a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afaa expref: 53 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.432334:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4ac41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afaa expref: 52 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.432343:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9071061f7f00) 00010000:00010000:1.0:1787893027.432346:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787893027.432350:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071421fa400, rc 0) 00000100:00100000:1.0:1787893027.432418:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710838a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+52:10454:x1874741431410944:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 Request processed in 367us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893027.432425:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 78 00000100:00100000:3.0:1787893027.444746:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893027.444922:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431411072 00000100:00100000:2.0:1787893027.444940:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431411072 00000100:00100000:2.0:1787893027.445038:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 26 00000100:00100000:2.0:1787893027.445051:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710838aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4829748d-dde1-497a-9623-0e4326f0972c+5:2362:x1874741431411072:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787893027.445078:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893027.445111:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054fb3861/0x825e3f5022b4ac48 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821afb1 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787893027.445149:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a911523, blocks: 0x1 00010000:00010000:2.0:1787893027.445189:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=355s v=(0 0) 00010000:00010000:2.0:1787893027.445194:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893027.445207:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054fb3861/0x825e3f5022b4ac48 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afb1 expref: 6 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.445431:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000054fb3861/0x825e3f5022b4ac48 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afb1 expref: 6 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.445454:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9ea00, rc 0) 00000100:00100000:2.0:1787893027.445560:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710838aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4829748d-dde1-497a-9623-0e4326f0972c+6:2362:x1874741431411072:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 Request processed in 509us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893027.445569:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 26 00000100:00100000:1.0:1787893027.453531:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893027.453665:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431411328 00000100:00100000:3.0:1787893027.453683:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431411328 00000100:00100000:3.0:1787893027.453804:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 79 00000100:00100000:3.0:1787893027.453818:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f57c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+52:10454:x1874741431411328:12345-192.168.202.29@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787893027.453974:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f57c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+52:10454:x1874741431411328:12345-192.168.202.29@tcp:57:lhsmtool_posix.0 Request processed in 158us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893027.453984:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 79 00000100:00100000:0.0:1787893027.457205:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893027.457306:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431411456 00000100:00100000:3.0:1787893027.457320:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431411456 00000100:00100000:3.0:1787893027.457395:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 27 00000100:00100000:3.0:1787893027.457409:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107e81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4829748d-dde1-497a-9623-0e4326f0972c+6:10454:x1874741431411456:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787893027.457434:0:8105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893027.457461:0:8105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049b820b1/0x825e3f5022b4ac4f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821afb8 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893027.457515:0:8105:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000054fb3861/0x825e3f5022b4ac48 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afb1 expref: 7 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893027.457526:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893027.457544:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893027.457552:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049b820b1/0x825e3f5022b4ac4f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afb8 expref: 7 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893027.457604:0:8105:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000054fb3861/0x825e3f5022b4ac48 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afb1 expref: 7 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893027.457622:0:8105:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000054fb3861/0x825e3f5022b4ac48 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afb1 expref: 7 pid: 6700 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893027.457642:0:8105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907108389180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8105:1874741455552512:192.168.202.29@tcp:104: 00000100:00100000:3.0:1787893027.457836:0:8105:0:(client.c:2715:ptlrpc_set_wait()) set ffff907139cde6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787893027.462463:0:8105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907108389180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8105:1874741455552512:192.168.202.29@tcp:104: 00010000:00010000:3.0:1787893027.462525:0:8105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000049b820b1/0x825e3f5022b4ac4f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afb8 expref: 7 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893027.462611:0:8105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907104f47200, rc 0) 00000100:00100000:3.0:1787893027.462747:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107e81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4829748d-dde1-497a-9623-0e4326f0972c+7:10454:x1874741431411456:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 Request processed in 5339us (5556us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893027.462785:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 27 00000100:00100000:1.0:1787893027.465138:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893027.465241:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431411584 00000100:00100000:2.0:1787893027.465252:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431411584 00010000:00010000:2.0:1787893027.465294:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000054fb3861/0x825e3f5022b4ac48 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afb1 expref: 7 pid: 6700 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893027.465341:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 42 00000100:00100000:2.0:1787893027.465352:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107fa5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4829748d-dde1-497a-9623-0e4326f0972c+7:2361:x1874741431411584:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787893027.465367:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893027.465395:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000054fb3861/0x825e3f5022b4ac48 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afb1 expref: 7 pid: 6700 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.465409:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000054fb3861/0x825e3f5022b4ac48 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afb1 expref: 7 pid: 6700 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.465447:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054fb3861/0x825e3f5022b4ac48 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afb1 expref: 7 pid: 6700 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.465462:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893027.465467:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893027.465474:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000049b820b1/0x825e3f5022b4ac4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afb8 expref: 6 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.465484:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049b820b1/0x825e3f5022b4ac4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afb8 expref: 6 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.465533:0:8463:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000049b820b1/0x825e3f5022b4ac4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afb8 expref: 6 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893027.465550:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907108384380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8463:1874741455552640:192.168.202.29@tcp:105: 00000100:00100000:2.0:1787893027.469882:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff907108643840 going to sleep for 11 seconds 00000100:00100000:0.0:1787893027.482629:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893027.482722:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431411712 00000100:00100000:3.0:1787893027.482735:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431411712 00002000:00100000:3.0:1787893027.482860:0:6707:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff907107e81880 x1874741431411712/t0(0) o4->4829748d-dde1-497a-9623-0e4326f0972c@192.168.202.29@tcp:188/0 lens 504/0 e 0 to 0 dl 1787893038 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787893027.482873:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff907107e81880 with x1874741431411712 ext(0->8) 00002000:00010000:3.0:1787893027.482881:0:6707:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff907107e81880 00000100:00100000:3.0:1787893027.482930:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 0 00000100:00100000:3.0:1787893027.482941:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107e81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4829748d-dde1-497a-9623-0e4326f0972c+7:2360:x1874741431411712:12345-192.168.202.29@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787893027.485857:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907108384380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8463:1874741455552640:192.168.202.29@tcp:105: 00010000:00010000:2.0:1787893027.486467:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893027.486587:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107fa5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4829748d-dde1-497a-9623-0e4326f0972c+7:2361:x1874741431411584:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 21233us (21456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893027.486603:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 42 00000100:00100000:3.0:1787893027.489364:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107e81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4829748d-dde1-497a-9623-0e4326f0972c+8:2360:x1874741431411712:12345-192.168.202.29@tcp:4:lhsmtool_posix.0 Request processed in 6412us (6739us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787893027.489381:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 0 00002000:00100000:3.0:1787893027.490128:0:6707:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff907107e81880 x1874741431411712/t4294967302(0) o4->4829748d-dde1-497a-9623-0e4326f0972c@192.168.202.29@tcp:188/0 lens 504/448 e 0 to 0 dl 1787893038 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787893027.490143:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff907107e81880 with x1874741431411712 ext(0->8) 00002000:00010000:3.0:1787893027.490150:0:6707:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff907107e81880 00000100:00100000:1.0:1787893027.498370:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893027.499976:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431411840 00000100:00100000:3.0:1787893027.499999:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431411840 00000100:00100000:3.0:1787893027.500199:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 80 00000100:00100000:3.0:1787893027.500213:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f57ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+52:10454:x1874741431411840:12345-192.168.202.29@tcp:44:lhsmtool_posix.0 00000040:00080000:3.0:1787893027.574285:0:12012:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787893027.574301:0:12012:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787893027.574428:0:12012:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787893027.574435:0:12012:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:0.0:1787893027.579581:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000001:00080000:0.0:1787893027.579613:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967355 is committed 00000004:00080000:0.0:1787893027.579635:0:5870:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:0.0:1787893027.579666:0:5870:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:0.0:1787893027.579677:0:5870:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff907108643b40 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1787893027.579681:0:5870:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff907110313f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9071086430c0 00000020:00080000:0.0:1787893027.579684:0:5870:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff907110313700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9071087b3400 00000020:00080000:0.0:1787893027.579714:0:5881:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1787893027.580065:0:5881:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1787893027.580122:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f57ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+13:10454:x1874741431411840:12345-192.168.202.29@tcp:44:lhsmtool_posix.0 Request processed in 79897us (81750us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893027.580137:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 80 00000100:00100000:2.0:1787893027.580366:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f57ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455552768:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787893027.580510:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893027.580591:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455552768 00000100:00100000:3.0:1787893027.580603:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455552768 00000100:00100000:0.0:1787893027.580638:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137e49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455552896:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787893027.580673:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893027.581098:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455552896 00000100:00080000:3.0:1787893027.581104:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787893027.581108:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455552896 00000100:00100000:0.0:1787893027.581121:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787893027.581133:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907108386a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455552768:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1787893027.581141:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787893027.581159:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787893027.581166:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107e83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1874741455552896:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787893027.581181:0:6700:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1787893027.581215:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a911520, atime: 0x6a911520, ctime: 0x6a911520, blocks: 0x1 00010000:00010000:2.0:1787893027.581225:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054fb3861/0x825e3f5022b4ac56 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.581241:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=355s v=(0 0) 00010000:00010000:2.0:1787893027.581246:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893027.581252:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054fb3861/0x825e3f5022b4ac56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.581267:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054fb3861/0x825e3f5022b4ac56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.581288:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054fb3861/0x825e3f5022b4ac56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.581296:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054fb3861/0x825e3f5022b4ac56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787893027.581302:0:6702:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787893027.581311:0:6702:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787893027 00002000:00010000:0.0:1787893027.581314:0:6702:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787893027.581316:0:6702:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787893027 -> 1787893027 00010000:00010000:2.0:1787893027.581319:0:6700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787893027.581319:0:6702:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787893027.581504:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907108386a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1874741455552768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 364us (986us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787893027.581512:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787893027.581905:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107e83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1874741455552896:12345-0@lo:6:osp-syn-0-0.0 Request processed in 737us (1230us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787893027.581912:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:0.0:1787893027.582011:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff907137e49180/2, rc 0, transno 4294967301 00000100:00100000:0.0:1787893027.582019:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137e49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455552896:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1787893027.582281:0:7644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893027.582296:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054fb3861/0x825e3f5022b4ac56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.582312:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9ea00 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:1.0:1787893027.582332:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054fb3861/0x825e3f5022b4ac56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.582344:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054fb3861/0x825e3f5022b4ac56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.582375:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054fb3861/0x825e3f5022b4ac56 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.582384:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054fb3861/0x825e3f5022b4ac56 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.582416:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893027.582419:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893027.582421:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787893027.582555:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90713f57ce00/2, rc 0, transno 4294967303 00000100:00100000:3.0:1787893027.582565:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f57ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455552768:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787893027.585199:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893027.585376:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431411968 00000100:00100000:2.0:1787893027.585390:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431411968 00000100:00100000:1.0:1787893027.585623:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 30 00000100:00100000:1.0:1787893027.585643:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4829748d-dde1-497a-9623-0e4326f0972c+8:2361:x1874741431411968:12345-192.168.202.29@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1787893027.669366:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:2.0:1787893027.669409:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:1.0:1787893027.669738:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4829748d-dde1-497a-9623-0e4326f0972c+6:2361:x1874741431411968:12345-192.168.202.29@tcp:16:lhsmtool_posix.0 Request processed in 84094us (84546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893027.669749:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 30 00000100:00100000:3.0:1787893027.675260:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893027.675389:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431412224 00000100:00100000:2.0:1787893027.675403:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431412224 00000100:00100000:2.0:1787893027.675581:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 81 00000100:00100000:2.0:1787893027.675596:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907108389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+13:10454:x1874741431412224:12345-192.168.202.29@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787893027.675670:0:8281:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893027.675709:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4ac41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afaa expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.675740:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9071061f7f00) 00010000:00010000:2.0:1787893027.675746:0:8281:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787893027.675855:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e000/0x825e3f5022b4ac5d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.675873:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e000/0x825e3f5022b4ac5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.675884:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e000/0x825e3f5022b4ac5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787893027.676224:0:8281:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000041138532 reply state 000000001086fca2 transno 4294967356 ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e000/0x825e3f5022b4ac5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893027.676234:0:8281:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787893027.676375:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907108389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+14:10454:x1874741431412224:12345-192.168.202.29@tcp:36:lhsmtool_posix.0 Request processed in 781us (1127us total) trans 4294967356 rc 0/0 00000100:00100000:2.0:1787893027.676384:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 81 00010000:00010000:2.0:1787893027.682450:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e000/0x825e3f5022b4ac5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.682482:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e000/0x825e3f5022b4ac5d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.682498:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e000/0x825e3f5022b4ac5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.682506:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9e000 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893027.682512:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e000/0x825e3f5022b4ac5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.682520:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e000/0x825e3f5022b4ac5d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.682545:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9071061f7f00) 00010000:00010000:2.0:1787893027.682549:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893027.682555:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e000/0x825e3f5022b4ac5d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.682561:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e000/0x825e3f5022b4ac5d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893027.683738:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893027.683924:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431412352 00000100:00100000:3.0:1787893027.683940:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431412352 00000100:00100000:3.0:1787893027.684126:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 31 00000100:00100000:3.0:1787893027.684143:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107e82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4829748d-dde1-497a-9623-0e4326f0972c+6:2361:x1874741431412352:12345-192.168.202.29@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787893027.684677:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1787893027.684683:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787893027 -> 1787893026 00002000:00010000:3.0:1787893027.684687:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787893024 00002000:00010000:3.0:1787893027.684690:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787893027 -> 1787893026 00002000:00010000:3.0:1787893027.684693:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787893027.685579:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107e82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4829748d-dde1-497a-9623-0e4326f0972c+7:2361:x1874741431412352:12345-192.168.202.29@tcp:2:lhsmtool_posix.0 Request processed in 1431us (1846us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787893027.685594:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 31 00000100:00100000:0.0:1787893027.688063:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893027.688187:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431412608 00000100:00100000:3.0:1787893027.688202:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431412608 00000100:00100000:3.0:1787893027.688312:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 82 00000100:00100000:3.0:1787893027.688325:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107e80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+13:10454:x1874741431412608:12345-192.168.202.29@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787893027.688432:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ac64 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893027.688453:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9400/0x825e3f5022b4ac1e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af9c expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893027.688715:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ac64 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893027.688792:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9400/0x825e3f5022b4ac1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af9c expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893027.688937:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9400/0x825e3f5022b4ac1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af9c expref: 13 pid: 5847 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893027.688957:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907108389880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1874741455553024:192.168.202.29@tcp:104: 00000100:00100000:3.0:1787893027.689150:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff907139cde9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787893027.691170:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907108389880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1874741455553024:192.168.202.29@tcp:104: 00010000:00010000:3.0:1787893027.691205:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ac64 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893027.694480:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893027.695933:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431412736 00000100:00100000:1.0:1787893027.695953:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431412736 00010000:00010000:1.0:1787893027.696018:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9400/0x825e3f5022b4ac1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af9c expref: 14 pid: 5847 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893027.696076:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 43 00000100:00100000:1.0:1787893027.696107:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907108389880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4829748d-dde1-497a-9623-0e4326f0972c+14:2361:x1874741431412736:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893027.696125:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893027.696141:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9400/0x825e3f5022b4ac1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af9c expref: 14 pid: 5847 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.696344:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9400/0x825e3f5022b4ac1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af9c expref: 14 pid: 5847 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.696372:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9400/0x825e3f5022b4ac1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af9c expref: 14 pid: 5847 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.696389:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9071061f7f00) 00010000:00010000:1.0:1787893027.696394:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ac64 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.696403:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ac64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.696411:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ac64 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.696514:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893027.696587:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907108389880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4829748d-dde1-497a-9623-0e4326f0972c+13:2361:x1874741431412736:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 482us (2130us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893027.696597:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 43 00010000:00010000:2.0:1787893027.700579:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ac64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.700599:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ac64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893027.700998:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ac64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893027.701017:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ac64 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893027.701027:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ac64 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893027.701034:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f47c00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893027.701039:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ac64 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893027.701048:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ac64 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893027.701073:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9071061f7f00) 00010000:00010000:3.0:1787893027.701077:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787893027.701106:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ac64 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893027.701112:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ac64 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893027.701257:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107e80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+12:10454:x1874741431412608:12345-192.168.202.29@tcp:55:lhsmtool_posix.0 Request processed in 12926us (13270us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787893027.701271:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 82 00000100:00100000:3.0:1787893027.704705:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893027.705330:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431412864 00000100:00100000:2.0:1787893027.705351:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431412864 00000100:00100000:2.0:1787893027.705431:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 32 00000100:00100000:2.0:1787893027.705592:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907108389500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4829748d-dde1-497a-9623-0e4326f0972c+7:2360:x1874741431412864:12345-192.168.202.29@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787893027.705651:0:6702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000897fec43/0x825e3f5022b4ac6b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.705672:0:6702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000049b820b1/0x825e3f5022b4ac4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afb8 expref: 7 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.705681:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893027.705685:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787893027.705690:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000897fec43/0x825e3f5022b4ac6b lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.705731:0:6702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000049b820b1/0x825e3f5022b4ac4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afb8 expref: 7 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.705744:0:6702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049b820b1/0x825e3f5022b4ac4f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afb8 expref: 7 pid: 8105 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893027.705801:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907108384380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6702:1874741455553152:192.168.202.29@tcp:104: 00000100:00100000:2.0:1787893027.706408:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set ffff907110297780 going to sleep for 11 seconds 00000100:00100000:1.0:1787893027.712789:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893027.712906:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431412992 00000100:00100000:0.0:1787893027.712925:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431412992 00010000:00010000:0.0:1787893027.713005:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000049b820b1/0x825e3f5022b4ac4f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afb8 expref: 8 pid: 8105 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893027.713067:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 44 00000100:00100000:0.0:1787893027.713080:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4829748d-dde1-497a-9623-0e4326f0972c+8:2362:x1874741431412992:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893027.713102:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893027.713132:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000049b820b1/0x825e3f5022b4ac4f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afb8 expref: 8 pid: 8105 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893027.713149:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000049b820b1/0x825e3f5022b4ac4f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afb8 expref: 8 pid: 8105 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893027.713183:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787893027.713189:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787893027.713204:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000897fec43/0x825e3f5022b4ac6b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893027.713215:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000897fec43/0x825e3f5022b4ac6b lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893027.713241:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893027.713319:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4829748d-dde1-497a-9623-0e4326f0972c+8:2362:x1874741431412992:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 241us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893027.713327:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 44 00010000:00010000:2.0:1787893027.719426:0:6702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049b820b1/0x825e3f5022b4ac4f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afb8 expref: 7 pid: 8105 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893027.719607:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907108384380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6702:1874741455553152:192.168.202.29@tcp:104: 00010000:00010000:2.0:1787893027.719636:0:6702:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000897fec43/0x825e3f5022b4ac6b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893027.719744:0:6702:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000897fec43/0x825e3f5022b4ac6b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893027.719799:0:6702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000897fec43/0x825e3f5022b4ac6b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893027.720387:0:6702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000897fec43/0x825e3f5022b4ac6b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893027.720398:0:6702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000897fec43/0x825e3f5022b4ac6b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893027.720408:0:6702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000897fec43/0x825e3f5022b4ac6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893027.720416:0:6702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9e000 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:0.0:1787893027.720422:0:6702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000897fec43/0x825e3f5022b4ac6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893027.720444:0:6702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000897fec43/0x825e3f5022b4ac6b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893027.720537:0:6702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000897fec43/0x825e3f5022b4ac6b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893027.720545:0:6702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000897fec43/0x825e3f5022b4ac6b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893027.720914:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907108389500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4829748d-dde1-497a-9623-0e4326f0972c+6:2360:x1874741431412864:12345-192.168.202.29@tcp:1:lhsmtool_posix.0 Request processed in 15451us (16221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893027.720928:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 32 00000100:00100000:3.0:1787893027.725312:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893027.727951:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431413248 00000100:00100000:0.0:1787893027.727971:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431413248 00000100:00100000:0.0:1787893027.728045:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 83 00000100:00100000:0.0:1787893027.728055:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907108388380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+12:10454:x1874741431413248:12345-192.168.202.29@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787893027.728140:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9400/0x825e3f5022b4ac72 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893027.728550:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9400/0x825e3f5022b4ac72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893027.728566:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9400/0x825e3f5022b4ac72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893027.729446:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4ac79 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893027.729471:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4ac2c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afa3 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893027.729478:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4ac79 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893027.729524:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4ac2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afa3 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893027.729539:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4ac2c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afa3 expref: 13 pid: 5847 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893027.729553:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e83100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1874741455553280:192.168.202.29@tcp:104: 00000100:00100000:0.0:1787893027.729651:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff907108112180 going to sleep for 11 seconds 00000100:00100000:1.0:1787893027.734464:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893027.734570:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431413376 00000100:00100000:3.0:1787893027.734587:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431413376 00000100:00100000:2.0:1787893027.734594:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e83100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1874741455553280:192.168.202.29@tcp:104: 00010000:00010000:2.0:1787893027.734636:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4ac79 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893027.734648:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4ac2c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afa3 expref: 14 pid: 5847 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893027.734703:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 45 00000100:00100000:3.0:1787893027.734717:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4829748d-dde1-497a-9623-0e4326f0972c+14:2360:x1874741431413376:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787893027.734737:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893027.734787:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4ac2c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afa3 expref: 14 pid: 5847 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893027.734805:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4ac2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afa3 expref: 14 pid: 5847 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893027.734849:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4ac2c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afa3 expref: 14 pid: 5847 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893027.734869:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9071061f7f00) 00010000:00010000:3.0:1787893027.734889:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4ac79 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893027.734902:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4ac79 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893027.734912:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4ac79 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893027.734946:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893027.735035:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4829748d-dde1-497a-9623-0e4326f0972c+13:2360:x1874741431413376:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 321us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893027.735044:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 45 00010000:00010000:2.0:1787893027.735430:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4ac79 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.735442:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4ac79 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787893027.735697:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1787893027.735910:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:2.0:1787893027.735958:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1787893027.736158:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907108384380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5849:1874741455553408:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787893027.736248:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893027.736341:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455553408 00000100:00100000:2.0:1787893027.736351:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455553408 00000100:00100000:2.0:1787893027.736406:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787893027.736417:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710838a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1874741455553408:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787893027.738487:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff907139cde9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787893027.739444:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710838a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1874741455553408:12345-0@lo:1000:mdt00_002.0 Request processed in 3018us (3186us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893027.739461:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787893027.739714:0:5849:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1787893027.739725:0:5849:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90713f57ce00, transno 4294967303 00000100:00100000:3.0:1787893027.739780:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907108384380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5849:1874741455553408:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1787893027.741120:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:3.0:1787893027.741240:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907108388700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5849:1874741455553536:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787893027.741330:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893027.741382:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff907139cde300 going to sleep for 11 seconds 00000100:00100000:2.0:1787893027.742945:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455553536 00000100:00100000:2.0:1787893027.742969:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455553536 00000100:00100000:2.0:1787893027.743043:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787893027.743055:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907108388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5849:x1874741455553536:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787893027.744529:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907108388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5849:x1874741455553536:12345-0@lo:1000:mdt00_002.0 Request processed in 1472us (3194us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787893027.744547:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787893027.745114:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907108388700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5849:1874741455553536:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1787893027.745183:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4ac79 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.745195:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4ac79 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.745202:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4ac79 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.745208:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc8200 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893027.745212:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4ac79 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.745219:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4ac79 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.745235:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9071061f7f00) 00010000:00010000:1.0:1787893027.745238:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787893027.745243:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4ac79 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.745249:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4ac79 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.745298:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9200/0x825e3f5022b4aba7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.745304:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9200/0x825e3f5022b4aba7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.745310:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9200/0x825e3f5022b4aba7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.745323:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071102b9200 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893027.745326:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9200/0x825e3f5022b4aba7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.745332:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9200/0x825e3f5022b4aba7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.745340:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105cfff00) 00010000:00010000:1.0:1787893027.745343:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787893027.745345:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9200/0x825e3f5022b4aba7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.745351:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9200/0x825e3f5022b4aba7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.745372:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4ac80 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.745384:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4abc3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af87 expref: 16 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.745393:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4ac80 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.745428:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4abc3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af87 expref: 16 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893027.745442:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4abc3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af87 expref: 16 pid: 8281 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893027.745468:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f57ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1874741455553664:192.168.202.29@tcp:104: 00000100:00100000:1.0:1787893027.745560:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff90713f545d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787893027.753937:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893027.754010:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431413504 00000100:00100000:0.0:1787893027.754020:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431413504 00010000:00010000:0.0:1787893027.754063:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4abc3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af87 expref: 17 pid: 8281 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893027.754111:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 46 00000100:00100000:0.0:1787893027.754121:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107e81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4829748d-dde1-497a-9623-0e4326f0972c+17:2360:x1874741431413504:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893027.754135:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893027.754150:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4abc3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af87 expref: 17 pid: 8281 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893027.754164:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4abc3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af87 expref: 17 pid: 8281 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893027.754188:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105cfff00) 00010000:00010000:0.0:1787893027.754193:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4ac80 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893027.754204:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4ac80 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893027.754212:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4ac80 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893027.754232:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893027.754289:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107e81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4829748d-dde1-497a-9623-0e4326f0972c+17:2360:x1874741431413504:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 169us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893027.754297:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 46 00010000:00010000:2.0:1787893027.754502:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8e00/0x825e3f5022b4abc3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821af87 expref: 16 pid: 8281 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893027.754532:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f57ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1874741455553664:192.168.202.29@tcp:104: 00010000:00010000:2.0:1787893027.754553:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4ac80 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.754562:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4ac80 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.754568:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4ac80 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.754580:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4ac80 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.754586:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4ac80 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.754593:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4ac80 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.754598:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fa000 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893027.754603:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4ac80 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.754610:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4ac80 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.754620:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105cfff00) 00010000:00010000:2.0:1787893027.754622:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893027.754625:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4ac80 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.754640:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4ac80 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.754655:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9400/0x825e3f5022b4ac72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.754661:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9400/0x825e3f5022b4ac72 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.754668:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9400/0x825e3f5022b4ac72 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.754673:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc9400 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893027.754676:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9400/0x825e3f5022b4ac72 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.754681:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9400/0x825e3f5022b4ac72 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.754688:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105cfff00) 00010000:00010000:2.0:1787893027.754690:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787893027.754693:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9400/0x825e3f5022b4ac72 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.754698:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9400/0x825e3f5022b4ac72 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893027.754963:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907108388380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+15:10454:x1874741431413248:12345-192.168.202.29@tcp:57:lhsmtool_posix.0 Request processed in 26909us (29667us total) trans 4294967361 rc 0/0 00000100:00100000:2.0:1787893027.754972:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 83 00000020:00080000:2.0:1787893027.754982:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787893027.755288:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787893027.755293:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787893027.755319:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787893027.755324:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787893027.758338:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893027.758392:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431413760 00000100:00100000:3.0:1787893027.758407:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431413760 00000100:00100000:3.0:1787893027.758485:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 20 00000100:00100000:3.0:1787893027.758511:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f536680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+15:10454:x1874741431413760:12345-192.168.202.29@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787893027.760224:0:5851:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787893027.760341:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967362 00010000:00010000:3.0:1787893027.760402:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4ac87 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893027.760422:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4ac87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893027.760435:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4ac87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893027.760444:0:5851:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4ac87 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893027.760452:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4ac87 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893027.760537:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4ac87 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893027.760570:0:5851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787893027.760713:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f536680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+17:10454:x1874741431413760:12345-192.168.202.29@tcp:35:lhsmtool_posix.0 Request processed in 2202us (2383us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1787893027.760725:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 20 00000020:00080000:3.0:1787893027.760732:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787893027.761249:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787893027.761259:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4ac87 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.761269:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f47600 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:2.0:1787893027.761274:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4ac87 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.761284:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4ac87 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.761302:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9071063d7600) 00010000:00010000:2.0:1787893027.761305:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787893027.761311:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4ac87 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.761317:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4ac87 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893027.761339:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893027.761341:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893027.761344:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893027.912944:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893028.403030:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893028.403091:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893028.403182:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431414016 00000100:00100000:0.0:1787893028.403197:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431414016 00000100:00100000:1.0:1787893028.403210:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893028.403299:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 74 00000100:00100000:0.0:1787893028.403313:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f57ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4829748d-dde1-497a-9623-0e4326f0972c+7:2363:x1874741431414016:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1787893028.403408:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f57ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4829748d-dde1-497a-9623-0e4326f0972c+7:2363:x1874741431414016:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 98us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893028.403439:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 74 00000100:00100000:3.0:1787893028.404981:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431414144 00000100:00100000:3.0:1787893028.405009:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431414144 00000100:00100000:3.0:1787893028.405117:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 136 00000100:00100000:3.0:1787893028.405130:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f566680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db96701a-d972-4021-b77b-4d58b82fa12c+5:2363:x1874741431414144:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1787893028.405217:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f566680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db96701a-d972-4021-b77b-4d58b82fa12c+5:2363:x1874741431414144:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 90us (2008us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893028.405240:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 136 00000100:00080000:3.0:1787893028.405270:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787893028.405280:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787893028.407308:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431413888 00000100:00100000:2.0:1787893028.407994:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431413888 00000100:00100000:2.0:1787893028.408340:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 286 00000100:00100000:2.0:1787893028.408357:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+13:2363:x1874741431413888:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1787893028.408523:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+13:2363:x1874741431413888:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 171us (5429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893028.408533:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 286 00010000:00010000:3.0:1787893028.938499:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893029.577387:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f536a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455553792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787893029.577611:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893029.577727:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455553792 00000100:00100000:2.0:1787893029.577744:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455553792 00000100:00100000:2.0:1787893029.577843:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787893029.577853:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f535180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1874741455553792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787893029.577896:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787893029.577945:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f535180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1874741455553792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893029.577953:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1787893029.578562:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787893029.578622:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f536a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455553792:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1787893029.668341:0:12064:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787893029.668352:0:12064:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787893029.668388:0:12064:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787893029.668394:0:12064:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1787893029.673654:0:6725:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:2.0:1787893029.673687:0:6725:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:1.0:1787893029.794487:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893029.794675:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431414400 00000100:00100000:2.0:1787893029.794691:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431414400 00000100:00100000:2.0:1787893029.794841:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 84 00000100:00100000:2.0:1787893029.794857:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f565180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+17:10473:x1874741431414400:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:2.0:1787893029.794895:0:8281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893029.794926:0:8281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f000/0x825e3f5022b4ac8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821afbf expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787893029.795603:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787893029.796448:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f800/0x825e3f5022b4ac95 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893029.796486:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f800/0x825e3f5022b4ac95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893029.796508:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f800/0x825e3f5022b4ac95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893029.796528:0:8281:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1787893029.797601:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f000/0x825e3f5022b4ac8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afbf expref: 20 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893029.797642:0:8281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f800/0x825e3f5022b4ac95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afbf expref: 19 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893029.797653:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff907105cff400) 00010000:00010000:2.0:1787893029.797656:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787893029.797661:0:8281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9f800, rc 0) 00000100:00100000:2.0:1787893029.798128:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f565180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+19:10473:x1874741431414400:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 3272us (3667us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1787893029.798140:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 84 00000100:00100000:0.0:1787893029.810650:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893029.810745:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431414528 00000100:00100000:3.0:1787893029.810788:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431414528 00000100:00100000:3.0:1787893029.810879:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 85 00000100:00100000:3.0:1787893029.810892:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107e82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+19:10473:x1874741431414528:12345-192.168.202.29@tcp:34:lfs.0 00010000:00010000:3.0:1787893029.810999:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4aca3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893029.811023:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4aca3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893029.811039:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4aca3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893029.811057:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4acaa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893029.811064:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4acaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893029.811070:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4acaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893029.811675:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4acb1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893029.811685:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4acb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893029.811693:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4acb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787893029.811779:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4acb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893029.811794:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4aca3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893029.811801:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4aca3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893029.811809:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4aca3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893029.811817:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f47c00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893029.811822:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4aca3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893029.811831:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4aca3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893029.811847:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff907105cff400) 00010000:00010000:3.0:1787893029.811851:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893029.811857:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4aca3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893029.811872:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4aca3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893029.811887:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4acaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893029.811893:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4acaa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893029.811899:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4acaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893029.811904:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f46000 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893029.811907:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4acaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893029.811913:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4acaa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893029.811921:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9071063d7b00) 00010000:00010000:3.0:1787893029.811924:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893029.811927:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4acaa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893029.811933:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4acaa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893029.811950:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4acb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893029.811956:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4acb1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893029.811969:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4acb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893029.811975:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f47e00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893029.811978:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4acb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893029.811984:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4acb1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893029.811992:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9071063d7400) 00010000:00010000:3.0:1787893029.811995:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893029.811998:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4acb1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893029.812006:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4acb1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893029.812123:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107e82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+19:10473:x1874741431414528:12345-192.168.202.29@tcp:34:lfs.0 Request processed in 1230us (1480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893029.812133:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 85 00000100:00100000:2.0:1787893029.857858:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893029.860232:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431414784 00000100:00100000:3.0:1787893029.860258:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431414784 00000100:00100000:2.0:1787893029.860368:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 86 00000100:00100000:2.0:1787893029.860383:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907108386300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+19:10476:x1874741431414784:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:2.0:1787893029.860413:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893029.860439:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f000/0x825e3f5022b4acb8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821afc6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893029.860548:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e600/0x825e3f5022b4acbf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893029.860564:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e600/0x825e3f5022b4acbf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893029.860574:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e600/0x825e3f5022b4acbf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893029.860586:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4acc6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893029.860602:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4acc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893029.860607:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4acc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893029.862185:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4accd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893029.862208:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4accd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893029.862223:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4accd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893029.862240:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1787893029.862373:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e600/0x825e3f5022b4acbf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893029.862382:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e600/0x825e3f5022b4acbf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893029.862391:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e600/0x825e3f5022b4acbf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893029.862397:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9e600 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893029.862403:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e600/0x825e3f5022b4acbf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893029.862412:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e600/0x825e3f5022b4acbf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893029.862437:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff907105cff400) 00010000:00010000:2.0:1787893029.862441:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893029.862448:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e600/0x825e3f5022b4acbf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893029.862455:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e600/0x825e3f5022b4acbf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893029.862484:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4acc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893029.862492:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4acc6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893029.862499:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4acc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893029.862505:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9fe00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893029.862509:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4acc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893029.862516:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4acc6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893029.862524:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff907105cffc00) 00010000:00010000:2.0:1787893029.862526:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893029.862529:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4acc6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893029.862535:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4acc6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893029.862615:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f000/0x825e3f5022b4acb8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afc6 expref: 22 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893029.862633:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4accd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afc6 expref: 21 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893029.862642:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105cffd00) 00010000:00010000:2.0:1787893029.862644:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787893029.862648:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9f400, rc 0) 00000100:00100000:2.0:1787893029.863893:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907108386300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+21:10476:x1874741431414784:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 3502us (6044us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1787893029.863911:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 86 00000100:00100000:1.0:1787893029.867920:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893029.868071:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431414912 00000100:00100000:0.0:1787893029.868085:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431414912 00000100:00100000:0.0:1787893029.868165:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 87 00000100:00100000:0.0:1787893029.868179:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f565500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+21:10476:x1874741431414912:12345-192.168.202.29@tcp:54:lfs.0 00010000:00010000:0.0:1787893029.868273:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4acdb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893029.868295:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4acdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893029.868309:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4acdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893029.868345:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4acdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893029.868354:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4acdb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893029.868363:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4acdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893029.868370:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc9800 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:0.0:1787893029.868376:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4acdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893029.868394:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4acdb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893029.868412:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105cffd00) 00010000:00010000:0.0:1787893029.868415:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787893029.868421:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4acdb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893029.868429:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4acdb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893029.869149:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f565500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+21:10476:x1874741431414912:12345-192.168.202.29@tcp:54:lfs.0 Request processed in 968us (1240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893029.869161:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 87 00000100:00100000:3.0:1787893029.891924:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893029.892642:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431415168 00000100:00100000:1.0:1787893029.892659:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431415168 00000100:00100000:1.0:1787893029.892746:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 21 00000100:00100000:1.0:1787893029.892783:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713044dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+21:10476:x1874741431415168:12345-192.168.202.29@tcp:35:lfs.0 00000100:00100000:1.0:1787893029.893142:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713044dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+22:10476:x1874741431415168:12345-192.168.202.29@tcp:35:lfs.0 Request processed in 362us (1233us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1787893029.893150:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 21 00000100:00100000:3.0:1787893029.953896:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893029.954746:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431415424 00000100:00100000:1.0:1787893029.954784:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431415424 00000100:00100000:1.0:1787893029.954866:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 88 00000100:00100000:1.0:1787893029.954880:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+22:9994:x1874741431415424:12345-192.168.202.29@tcp:101:bash.0 00010000:00010000:1.0:1787893029.954918:0:8281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893029.954949:0:8281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4ace2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821afcd expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893029.955101:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4ace9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893029.955137:0:8281:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4accd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afc6 expref: 23 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893029.955146:0:8281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4ace9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893029.955193:0:8281:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4accd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afc6 expref: 23 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893029.955207:0:8281:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4accd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afc6 expref: 23 pid: 5849 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893029.955223:0:8281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f566a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8281:1874741455553920:192.168.202.29@tcp:104: 00000100:00100000:1.0:1787893029.955357:0:8281:0:(client.c:2715:ptlrpc_set_wait()) set ffff907109145b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787893029.968564:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893029.968619:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431415552 00000100:00100000:1.0:1787893029.968632:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431415552 00010000:00010000:1.0:1787893029.968689:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4accd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afc6 expref: 24 pid: 5849 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893029.968739:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 47 00000100:00100000:1.0:1787893029.968775:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f566300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4829748d-dde1-497a-9623-0e4326f0972c+24:2361:x1874741431415552:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893029.968797:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893029.968806:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4accd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afc6 expref: 24 pid: 5849 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893029.968842:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4accd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afc6 expref: 24 pid: 5849 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893029.968873:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105cffd00) 00010000:00010000:1.0:1787893029.968881:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4ace9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893029.968893:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4ace9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893029.968901:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4ace9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893029.968926:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893029.968994:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f566300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4829748d-dde1-497a-9623-0e4326f0972c+24:2361:x1874741431415552:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 245us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893029.969003:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 47 00010000:00010000:3.0:1787893029.969911:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4accd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afc6 expref: 23 pid: 5849 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893029.969937:0:8281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f566a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8281:1874741455553920:192.168.202.29@tcp:104: 00010000:00010000:3.0:1787893029.969979:0:8281:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4ace9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893029.969989:0:8281:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4ace9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893029.969995:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4ace9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893029.970020:0:8281:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1787893029.970237:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4ace2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afcd expref: 24 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893029.970260:0:8281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4ace9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afcd expref: 23 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893029.970271:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105cffd00) 00010000:00010000:3.0:1787893029.970274:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787893029.970277:0:8281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071421fa000, rc 0) 00000100:00100000:3.0:1787893029.970359:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+23:9994:x1874741431415424:12345-192.168.202.29@tcp:101:bash.0 Request processed in 15481us (16479us total) trans 4294967367 rc 0/0 00000100:00100000:3.0:1787893029.970369:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 88 00010000:00010000:2.0:1787893029.973281:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893029.991726:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893029.991948:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431415808 00000100:00100000:1.0:1787893029.991962:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431415808 00000100:00100000:1.0:1787893029.992043:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 89 00000100:00100000:1.0:1787893029.992056:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f535880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+23:9994:x1874741431415808:12345-192.168.202.29@tcp:36:bash.0 00010000:00010000:1.0:1787893029.992447:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4acf7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893029.992482:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4acf7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893029.992497:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4acf7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787893029.992589:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000004:00010000:1.0:1787893029.992622:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002d7d8bfb reply state 0000000078113b42 transno 4294967369 ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4acf7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893029.992634:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1787893029.992693:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000100:00100000:1.0:1787893029.992899:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f535880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+27:9994:x1874741431415808:12345-192.168.202.29@tcp:36:bash.0 Request processed in 842us (1187us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1787893029.992908:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 89 00000020:00080000:1.0:1787893029.992915:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1787893030.007694:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4acf7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.007715:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4acf7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.007724:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4acf7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.007730:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fb600 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893030.007736:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4acf7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.007745:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4acf7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.007794:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105cffd00) 00010000:00010000:1.0:1787893030.007798:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893030.007803:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4acf7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.007832:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4acf7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893030.007984:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893030.008017:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431415936 00000100:00100000:1.0:1787893030.008028:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431415936 00000100:00100000:1.0:1787893030.008092:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 90 00000100:00100000:1.0:1787893030.008105:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f566a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+26:9994:x1874741431415936:12345-192.168.202.29@tcp:101:bash.0 00010000:00010000:1.0:1787893030.008136:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893030.008162:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4acfe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821afd4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.008240:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4acfe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afd4 expref: 27 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.008254:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4acfe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afd4 expref: 27 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.008279:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105cffd00) 00010000:00010000:1.0:1787893030.008282:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787893030.008285:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071421fb400, rc 0) 00000100:00100000:1.0:1787893030.008360:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f566a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+27:9994:x1874741431415936:12345-192.168.202.29@tcp:101:bash.0 Request processed in 258us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893030.008369:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 90 00000100:00100000:1.0:1787893030.014258:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893030.014374:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431416064 00000100:00100000:2.0:1787893030.014388:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431416064 00000100:00100000:2.0:1787893030.014560:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 33 00000100:00100000:2.0:1787893030.014575:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907108389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4829748d-dde1-497a-9623-0e4326f0972c+6:9994:x1874741431416064:12345-192.168.202.29@tcp:101:bash.0 00010000:00010000:2.0:1787893030.014602:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893030.014634:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063968e9f/0x825e3f5022b4ad05 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821afdb expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787893030.014674:0:6701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a911522, atime: 0x6a911520, ctime: 0x6a911522, blocks: 0xb 00010000:00010000:2.0:1787893030.014705:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=357s v=(0 0) 00010000:00010000:2.0:1787893030.014711:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893030.014722:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063968e9f/0x825e3f5022b4ad05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afdb expref: 7 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.014800:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000063968e9f/0x825e3f5022b4ad05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afdb expref: 7 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.014817:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9f000, rc 0) 00000100:00100000:2.0:1787893030.014894:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907108389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4829748d-dde1-497a-9623-0e4326f0972c+7:9994:x1874741431416064:12345-192.168.202.29@tcp:101:bash.0 Request processed in 323us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893030.014902:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 33 00000100:00080000:3.0:1787893030.015203:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787893030.018694:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893030.019000:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431416192 00000100:00100000:0.0:1787893030.019015:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431416192 00002000:00010000:0.0:1787893030.019072:0:6705:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1787893030.019078:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90710838ad80 with x1874741431416192 ext(0->18446744073709551615) 00002000:00010000:0.0:1787893030.019094:0:6705:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90710838ad80. 00000100:00100000:0.0:1787893030.019122:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1 00000100:00100000:0.0:1787893030.019133:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710838ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4829748d-dde1-497a-9623-0e4326f0972c+7:2360:x1874741431416192:12345-192.168.202.29@tcp:10:bash.0 00002000:00010000:0.0:1787893030.019616:0:6705:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787893030.019621:0:6705:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787893026 -> 1787893029 00002000:00010000:0.0:1787893030.019624:0:6705:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1787893024 -> 1787893024 00002000:00010000:0.0:1787893030.019625:0:6705:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787893026 -> 1787893029 00002000:00010000:0.0:1787893030.019627:0:6705:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1787893030.019864:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710838ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4829748d-dde1-497a-9623-0e4326f0972c+8:2360:x1874741431416192:12345-192.168.202.29@tcp:10:bash.0 Request processed in 729us (1181us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787893030.019889:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1 00002000:00010000:0.0:1787893030.019893:0:6705:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1787893030.019896:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90710838ad80 with x1874741431416192 ext(0->18446744073709551615) 00002000:00010000:0.0:1787893030.019902:0:6705:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90710838ad80. 00000100:00100000:1.0:1787893030.127430:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893030.128951:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431416320 00000100:00100000:3.0:1787893030.128967:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431416320 00000100:00100000:3.0:1787893030.129053:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 91 00000100:00100000:3.0:1787893030.129067:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710838b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+27:10490:x1874741431416320:12345-192.168.202.29@tcp:34:lfs.0 00010000:00010000:3.0:1787893030.129173:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4ad0c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.129204:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4ad0c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.129220:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4ad0c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.129239:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4ad13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.129248:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4ad13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.129255:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4ad13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.129854:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ad1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.129865:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ad1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.129873:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ad1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787893030.129925:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ad1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.129938:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4ad0c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.129945:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4ad0c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.129962:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4ad0c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.129970:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f47e00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893030.129976:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4ad0c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.129984:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4ad0c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.129999:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff907105cff400) 00010000:00010000:3.0:1787893030.130002:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893030.130007:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4ad0c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.130013:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4ad0c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.130025:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4ad13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.130031:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4ad13 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.130037:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4ad13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.130041:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f46000 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893030.130043:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4ad13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.130059:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4ad13 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.130068:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9071063d7b00) 00010000:00010000:3.0:1787893030.130070:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893030.130073:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4ad13 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.130080:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4ad13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.130097:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ad1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.130103:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ad1a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.130109:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ad1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.130114:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f47c00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893030.130117:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ad1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.130124:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ad1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.130130:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105cffd00) 00010000:00010000:3.0:1787893030.130132:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893030.130135:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ad1a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.130151:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ad1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893030.130266:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710838b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+27:10490:x1874741431416320:12345-192.168.202.29@tcp:34:lfs.0 Request processed in 1199us (2849us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893030.130275:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 91 00000100:00100000:2.0:1787893030.177003:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893030.177176:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431416576 00000100:00100000:1.0:1787893030.177189:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431416576 00000100:00100000:1.0:1787893030.177279:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 92 00000100:00100000:1.0:1787893030.177292:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907108387800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+27:10493:x1874741431416576:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:1.0:1787893030.177323:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893030.177353:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4ad21 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821afe2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.178246:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4ad28 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.178269:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4ad28 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.178283:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4ad28 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.178305:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4ad2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.178313:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4ad2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.178321:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4ad2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.179299:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4ad36 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.179318:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4ad36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.179344:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4ad36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893030.179360:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787893030.179748:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4ad28 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.181999:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4ad28 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.182012:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4ad28 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.182020:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fa400 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893030.182026:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4ad28 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.182039:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4ad28 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.182066:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff907105cff400) 00010000:00010000:1.0:1787893030.182070:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893030.182078:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4ad28 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.182085:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4ad28 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.182123:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4ad2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.182130:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4ad2f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.182165:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4ad2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.182171:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153b000 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893030.182174:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4ad2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.182181:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4ad2f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.182190:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff907105907300) 00010000:00010000:1.0:1787893030.182193:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893030.182196:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4ad2f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.182202:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4ad2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.182305:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4ad21 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afe2 expref: 30 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.182330:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4ad36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afe2 expref: 29 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.182339:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105cffd00) 00010000:00010000:1.0:1787893030.182341:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787893030.182344:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90710153bc00, rc 0) 00000100:00100000:1.0:1787893030.184242:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907108387800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+29:10493:x1874741431416576:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 6935us (7238us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1787893030.184284:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 92 00000100:00100000:1.0:1787893030.196214:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893030.196804:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431416704 00000100:00100000:3.0:1787893030.196819:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431416704 00000100:00100000:3.0:1787893030.196908:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 93 00000100:00100000:3.0:1787893030.196922:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907108388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+29:10493:x1874741431416704:12345-192.168.202.29@tcp:54:lfs.0 00010000:00010000:3.0:1787893030.197023:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ad44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.197046:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4ace9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afcd expref: 29 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.197057:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ad44 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.197104:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4ace9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afcd expref: 29 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.197120:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4ace9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afcd expref: 29 pid: 8281 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893030.197138:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f535500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1874741455554048:192.168.202.29@tcp:104: 00000100:00100000:3.0:1787893030.197271:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff90713f588600 going to sleep for 11 seconds 00000100:00100000:2.0:1787893030.201070:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893030.201107:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f535500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1874741455554048:192.168.202.29@tcp:104: 00010000:00010000:3.0:1787893030.201151:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ad44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893030.201267:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431416960 00000100:00100000:1.0:1787893030.201278:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431416960 00000100:00100000:1.0:1787893030.201360:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 22 00000100:00100000:1.0:1787893030.201381:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907108385c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+30:5600:x1874741431416960:12345-192.168.202.29@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787893030.202172:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907108385c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+31:5600:x1874741431416960:12345-192.168.202.29@tcp:35:ldlm_bl.0 Request processed in 797us (1117us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1787893030.202182:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 22 00000100:00100000:2.0:1787893030.205060:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893030.205721:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431417088 00000100:00100000:0.0:1787893030.205736:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431417088 00010000:00010000:0.0:1787893030.205853:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4ace9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afcd expref: 31 pid: 8281 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893030.205915:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 48 00000100:00100000:0.0:1787893030.205930:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907108385f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4829748d-dde1-497a-9623-0e4326f0972c+31:2360:x1874741431417088:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893030.205952:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893030.205960:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4ace9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afcd expref: 31 pid: 8281 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893030.205977:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4ace9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afcd expref: 31 pid: 8281 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893030.206006:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4ace9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afcd expref: 31 pid: 8281 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893030.206031:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105cffd00) 00010000:00010000:0.0:1787893030.206037:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ad44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893030.206048:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ad44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893030.206075:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ad44 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893030.206117:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893030.206193:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907108385f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4829748d-dde1-497a-9623-0e4326f0972c+30:2360:x1874741431417088:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 267us (1147us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893030.206201:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 48 00010000:00010000:2.0:1787893030.206353:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ad44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.206363:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ad44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.206424:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ad44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.206431:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ad44 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.206440:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ad44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.206456:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f47c00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893030.206462:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ad44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.206815:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ad44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.206830:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105cffd00) 00010000:00010000:2.0:1787893030.206833:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787893030.206840:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ad44 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.206846:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ad44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893030.206931:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907108388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+29:10493:x1874741431416704:12345-192.168.202.29@tcp:54:lfs.0 Request processed in 10010us (10729us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893030.206941:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 93 00000100:00100000:0.0:1787893030.213881:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893030.213990:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431417344 00000100:00100000:1.0:1787893030.214004:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431417344 00000100:00100000:1.0:1787893030.214082:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 23 00000100:00100000:1.0:1787893030.214096:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107e80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+29:10493:x1874741431417344:12345-192.168.202.29@tcp:35:lfs.0 00000100:00100000:1.0:1787893030.214432:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107e80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+30:10493:x1874741431417344:12345-192.168.202.29@tcp:35:lfs.0 Request processed in 339us (565us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1787893030.214442:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 23 00000100:00100000:1.0:1787893030.315216:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893030.315312:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431417600 00000100:00100000:3.0:1787893030.315324:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431417600 00000100:00100000:3.0:1787893030.315401:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 94 00000100:00100000:3.0:1787893030.315413:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712eb57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+30:10504:x1874741431417600:12345-192.168.202.29@tcp:101:cat.0 00010000:00010000:3.0:1787893030.315456:0:8281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893030.315493:0:8281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4ad4b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821afe9 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.315600:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4ad52 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.315617:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4ad52 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.315634:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4ad52 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.315653:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ad59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.315661:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ad59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.315668:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ad59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.316256:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4ad60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.316276:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4ad60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.316285:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4ad60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893030.316298:0:8281:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1787893030.316497:0:8281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4ad52 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.316507:0:8281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4ad52 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.316514:0:8281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4ad52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.316521:0:8281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f47e00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893030.316527:0:8281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4ad52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.316535:0:8281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4ad52 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.316551:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff907105cff400) 00010000:00010000:3.0:1787893030.316555:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893030.316560:0:8281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4ad52 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.316567:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4ad52 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.316583:0:8281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ad59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.316597:0:8281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ad59 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.316604:0:8281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ad59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.316610:0:8281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f47c00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893030.316614:0:8281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ad59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.316621:0:8281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ad59 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.316629:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9071063d7b00) 00010000:00010000:3.0:1787893030.316632:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893030.316635:0:8281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ad59 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.316642:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ad59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.316708:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4ad4b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afe9 expref: 33 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.316724:0:8281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4ad60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afe9 expref: 32 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.316732:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105cffd00) 00010000:00010000:3.0:1787893030.316734:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787893030.316743:0:8281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907104f47600, rc 0) 00000100:00100000:3.0:1787893030.316889:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712eb57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+32:10504:x1874741431417600:12345-192.168.202.29@tcp:101:cat.0 Request processed in 1475us (1687us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1787893030.316901:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 94 00000100:00100000:2.0:1787893030.321882:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893030.321985:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431417856 00000100:00100000:3.0:1787893030.321999:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431417856 00000100:00100000:3.0:1787893030.322071:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 24 00000100:00100000:3.0:1787893030.322082:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907108384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+32:10504:x1874741431417856:12345-192.168.202.29@tcp:35:cat.0 00000100:00100000:3.0:1787893030.322422:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907108384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+33:10504:x1874741431417856:12345-192.168.202.29@tcp:35:cat.0 Request processed in 340us (555us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1787893030.322430:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 24 00000100:00100000:0.0:1787893030.338904:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893030.339049:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431418112 00000100:00100000:1.0:1787893030.339063:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431418112 00000100:00100000:1.0:1787893030.339148:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 95 00000100:00100000:1.0:1787893030.339161:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107e83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+33:10505:x1874741431418112:12345-192.168.202.29@tcp:36:rm.0 00010000:00010000:1.0:1787893030.339243:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787893030.339281:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4ad60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afe9 expref: 33 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.339338:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4ad36 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afe2 expref: 32 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.339357:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4acfe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afd4 expref: 31 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.339372:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105cffd00) 00010000:00010000:1.0:1787893030.339387:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787893030.339415:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4ad6e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.339431:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4ad6e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.339443:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4ad6e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.339462:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4ad75 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.339480:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4ad75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.339487:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4ad75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.340211:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4ad7c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.340224:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4ad7c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.340240:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4ad7c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787893030.343539:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:1.0:1787893030.343558:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 358110805172ns, next at 359110800780ns, rc = 0 00010000:00010000:1.0:1787893030.345943:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b200/0x825e3f5022b4ad83 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.345976:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b200/0x825e3f5022b4ad83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.345991:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b200/0x825e3f5022b4ad83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.346002:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b200/0x825e3f5022b4ad83 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.346010:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b200/0x825e3f5022b4ad83 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.346018:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b200/0x825e3f5022b4ad83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.346123:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787893030.346155:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4ad7c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.346163:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4ad7c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.346170:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4ad7c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.346195:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153a200 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893030.346201:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4ad7c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.346210:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4ad7c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.346226:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105907200) 00010000:00010000:1.0:1787893030.346229:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787893030.346235:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4ad7c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.346242:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4ad7c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.346273:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4ad6e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.346280:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4ad6e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.346287:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4ad6e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.346293:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153b600 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893030.346297:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4ad6e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.346304:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4ad6e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.346324:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff907105cff400) 00010000:00010000:1.0:1787893030.346327:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893030.346330:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4ad6e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.346337:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4ad6e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787893030.346350:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a4835e9 reply state 00000000d43e9c28 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4ad75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893030.346361:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787893030.351907:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107e83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+32:10505:x1874741431418112:12345-192.168.202.29@tcp:36:rm.0 Request processed in 12726us (12996us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1787893030.351924:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 95 00010000:00010000:1.0:1787893030.357643:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4ad75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.357669:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4ad75 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.357678:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4ad75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.357685:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153a000 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893030.357691:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4ad75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.357700:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4ad75 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.357774:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff907105907300) 00010000:00010000:1.0:1787893030.357778:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893030.357784:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4ad75 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.357792:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4ad75 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.358019:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787893030.358028:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b200/0x825e3f5022b4ad83 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.358036:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153b200 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:2.0:1787893030.358041:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b200/0x825e3f5022b4ad83 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.358048:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b200/0x825e3f5022b4ad83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.358059:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff907105907200) 00010000:00010000:2.0:1787893030.358062:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787893030.358066:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b200/0x825e3f5022b4ad83 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.358085:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b200/0x825e3f5022b4ad83 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.358106:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893030.358108:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893030.358110:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893030.439157:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893030.439340:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431418368 00000100:00100000:3.0:1787893030.439354:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431418368 00000100:00100000:3.0:1787893030.439443:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 96 00000100:00100000:3.0:1787893030.439455:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+31:10511:x1874741431418368:12345-192.168.202.29@tcp:101:bash.0 00010000:00010000:3.0:1787893030.439503:0:8281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893030.439538:0:8281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4ad8a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821aff0 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.439927:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ad91 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.439947:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ad91 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.439960:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ad91 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.439979:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4ad98 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.440006:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4ad98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.440014:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4ad98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787893030.441007:0:8281:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1787893030.441957:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4ad9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.441980:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4ad9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.441998:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4ad9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.442056:0:8281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ad91 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.442065:0:8281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ad91 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.442074:0:8281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ad91 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.442082:0:8281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f47c00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893030.442088:0:8281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ad91 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.442098:0:8281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ad91 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.442137:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff907105cff400) 00010000:00010000:3.0:1787893030.442140:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893030.442146:0:8281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ad91 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.442153:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ad91 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787893030.442174:0:8281:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009ce36903 reply state 000000006207bb3f transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4ad98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893030.442328:0:8281:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787893030.442376:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4ad8a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aff0 expref: 34 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.442395:0:8281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4ad9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aff0 expref: 33 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.442404:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9071063d7d00) 00010000:00010000:3.0:1787893030.442407:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787893030.442410:0:8281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907104f47200, rc 0) 00000100:00100000:3.0:1787893030.442614:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+34:10511:x1874741431418368:12345-192.168.202.29@tcp:101:bash.0 Request processed in 3159us (3472us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1787893030.442625:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 96 00010000:00010000:1.0:1787893030.452396:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4ad98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.452421:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4ad98 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.452430:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4ad98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.452438:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f47e00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893030.452444:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4ad98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.452454:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4ad98 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.452489:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9071063d7b00) 00010000:00010000:1.0:1787893030.452494:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893030.452500:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4ad98 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.452507:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4ad98 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893030.457267:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893030.457436:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431418496 00000100:00100000:2.0:1787893030.457448:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431418496 00000100:00100000:2.0:1787893030.457537:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 34 00000100:00100000:2.0:1787893030.457547:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907110cfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4829748d-dde1-497a-9623-0e4326f0972c+5:2362:x1874741431418496:12345-192.168.202.29@tcp:101:bash.0 00010000:00010000:2.0:1787893030.457567:0:8105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893030.457590:0:8105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001444a258/0x825e3f5022b4adad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821aff7 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787893030.457618:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787893030.457637:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=358s v=(0 0) 00010000:00010000:2.0:1787893030.457642:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893030.457651:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001444a258/0x825e3f5022b4adad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aff7 expref: 6 pid: 8105 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.457671:0:8105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001444a258/0x825e3f5022b4adad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aff7 expref: 6 pid: 8105 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.457689:0:8105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9fc00, rc 0) 00000100:00080000:3.0:1787893030.457833:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787893030.457920:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907110cfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4829748d-dde1-497a-9623-0e4326f0972c+6:2362:x1874741431418496:12345-192.168.202.29@tcp:101:bash.0 Request processed in 370us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893030.457952:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 34 00000100:00100000:3.0:1787893030.465956:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893030.466186:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431418624 00000100:00100000:2.0:1787893030.466198:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431418624 00000100:00100000:2.0:1787893030.466481:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 35 00000100:00100000:2.0:1787893030.466494:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f535500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4829748d-dde1-497a-9623-0e4326f0972c+6:10511:x1874741431418624:12345-192.168.202.29@tcp:101:bash.0 00010000:00010000:2.0:1787893030.466517:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893030.466545:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000897fec43/0x825e3f5022b4adb4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821affe expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.466580:0:6701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001444a258/0x825e3f5022b4adad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aff7 expref: 7 pid: 8105 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.466591:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893030.466596:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893030.466602:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000897fec43/0x825e3f5022b4adb4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821affe expref: 7 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.466653:0:6701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001444a258/0x825e3f5022b4adad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aff7 expref: 7 pid: 8105 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.466668:0:6701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001444a258/0x825e3f5022b4adad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aff7 expref: 7 pid: 8105 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893030.466683:0:6701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907108385500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6701:1874741455554176:192.168.202.29@tcp:104: 00000100:00100000:2.0:1787893030.466832:0:6701:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071102973c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787893030.495093:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893030.495229:0:6701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907108385500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6701:1874741455554176:192.168.202.29@tcp:104: 00010000:00010000:2.0:1787893030.495265:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000897fec43/0x825e3f5022b4adb4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821affe expref: 7 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.495291:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9e000, rc 0) 00000100:00100000:2.0:1787893030.495398:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f535500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4829748d-dde1-497a-9623-0e4326f0972c+7:10511:x1874741431418624:12345-192.168.202.29@tcp:101:bash.0 Request processed in 28906us (29470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893030.495408:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 35 00000100:00100000:1.0:1787893030.495741:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431418752 00000100:00100000:1.0:1787893030.495749:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431418752 00010000:00010000:1.0:1787893030.495823:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001444a258/0x825e3f5022b4adad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aff7 expref: 7 pid: 8105 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893030.495854:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 49 00000100:00100000:1.0:1787893030.495861:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107fa5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4829748d-dde1-497a-9623-0e4326f0972c+7:2360:x1874741431418752:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893030.495875:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893030.495898:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001444a258/0x825e3f5022b4adad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aff7 expref: 7 pid: 8105 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.495911:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001444a258/0x825e3f5022b4adad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aff7 expref: 7 pid: 8105 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.495934:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001444a258/0x825e3f5022b4adad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aff7 expref: 7 pid: 8105 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.495948:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893030.495952:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893030.495961:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000897fec43/0x825e3f5022b4adb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821affe expref: 6 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.495971:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000897fec43/0x825e3f5022b4adb4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821affe expref: 6 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.496019:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000897fec43/0x825e3f5022b4adb4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821affe expref: 6 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893030.496033:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712eb54e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5833:1874741455554304:192.168.202.29@tcp:105: 00000100:00100000:1.0:1787893030.498736:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff907109145540 going to sleep for 11 seconds 00000100:00100000:1.0:1787893030.506901:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712eb54e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5833:1874741455554304:192.168.202.29@tcp:105: 00010000:00010000:1.0:1787893030.506952:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893030.507024:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107fa5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4829748d-dde1-497a-9623-0e4326f0972c+6:2360:x1874741431418752:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 11160us (11939us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893030.507035:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 49 00000100:00100000:3.0:1787893030.515310:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893030.516070:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431419008 00000100:00100000:1.0:1787893030.516082:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431419008 00000100:00100000:1.0:1787893030.516155:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 25 00000100:00100000:1.0:1787893030.516166:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+33:10511:x1874741431419008:12345-192.168.202.29@tcp:35:bash.0 00000100:00100000:1.0:1787893030.516557:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+34:10511:x1874741431419008:12345-192.168.202.29@tcp:35:bash.0 Request processed in 391us (1265us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1787893030.516566:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 25 00000100:00100000:3.0:1787893030.601235:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f535f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455554816:0@lo:400:kworker.0 00000100:00100000:3.0:1787893030.601330:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893030.601395:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787893030.601402:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f535c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874741455554688:0@lo:400:kworker.0 00000100:00100000:3.0:1787893030.601430:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893030.601824:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f537800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874741455554560:0@lo:400:kworker.0 00000100:00100000:2.0:1787893030.601859:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893030.601891:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f534700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455555072:0@lo:400:kworker.0 00000100:00100000:2.0:1787893030.601915:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893030.601954:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787893030.601961:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f536300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22d910cf-711e-44e0-9acf-212404ada550:3306:1874741455554432:0@lo:400:kworker.0 00000100:00100000:2.0:1787893030.601990:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893030.602014:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f534a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874741455554944:0@lo:400:kworker.0 00000100:00100000:2.0:1787893030.602035:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893030.602065:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455554688 00000100:00100000:2.0:1787893030.602073:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455554688 00000100:00100000:2.0:1787893030.602129:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455554560 00000100:00100000:2.0:1787893030.602133:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455554560 00000100:00100000:2.0:1787893030.602329:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455554944 00000100:00100000:2.0:1787893030.602333:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455554944 00000100:00100000:2.0:1787893030.602355:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787893030.602364:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f537100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874741455554688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893030.602426:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f537100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874741455554688:12345-0@lo:400:kworker.0 Request processed in 62us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893030.602457:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787893030.602492:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787893030.602499:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907108385500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874741455554560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893030.602555:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907108385500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874741455554560:12345-0@lo:400:kworker.0 Request processed in 56us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893030.602561:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787893030.602574:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787893030.602580:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907108384700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874741455554944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893030.602608:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907108384700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874741455554944:12345-0@lo:400:kworker.0 Request processed in 29us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893030.602614:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787893030.602637:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455554816 00000100:00100000:2.0:1787893030.602640:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455554816 00000100:00100000:2.0:1787893030.602666:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455555072 00000100:00100000:2.0:1787893030.602669:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455555072 00000100:00100000:2.0:1787893030.602691:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787893030.602697:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f536d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455554816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893030.602731:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f536d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455554816:12345-0@lo:400:kworker.0 Request processed in 34us (1402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893030.602737:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787893030.602778:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787893030.602786:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907108386a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1874741455555072:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787893030.603318:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787893030.603324:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787893030.603336:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455554432 00000100:00100000:1.0:1787893030.603341:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455554432 00000100:00100000:1.0:1787893030.603373:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1787893030.603380:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+19:3306:x1874741455554432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893030.603419:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a09450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+19:3306:x1874741455554432:12345-0@lo:400:kworker.0 Request processed in 40us (1429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893030.603448:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1787893030.603515:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f535c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874741455554688:0@lo:400:kworker.0 00000100:00100000:1.0:1787893030.603527:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1787893030.603783:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:1.0:1787893030.603826:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff907137e49180, transno 4294967301 00000100:00100000:1.0:1787893030.603839:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f535f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455554816:0@lo:400:kworker.0 00000100:00100000:1.0:1787893030.604401:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f536300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22d910cf-711e-44e0-9acf-212404ada550:3306:1874741455554432:0@lo:400:kworker.0 00000100:00100000:1.0:1787893030.604416:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f534a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874741455554944:0@lo:400:kworker.0 00000100:00100000:2.0:1787893030.605273:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907108386a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1874741455555072:12345-0@lo:400:kworker.0 Request processed in 2361us (3230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893030.605285:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787893030.605380:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f537800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874741455554560:0@lo:400:kworker.0 00000100:00100000:1.0:1787893030.605404:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f534700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455555072:0@lo:400:kworker.0 00000100:00100000:3.0:1787893030.696709:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893030.697132:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431419136 00000100:00100000:2.0:1787893030.697152:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431419136 00000100:00100000:2.0:1787893030.697213:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 97 00000100:00100000:2.0:1787893030.697224:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f534000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+34:10527:x1874741431419136:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:2.0:1787893030.697258:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893030.697279:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4adbb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b005 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.697349:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4adc2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.697364:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4adc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.697376:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4adc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893030.697453:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787893030.697457:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787893030.697492:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4adc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.697518:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4adbb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b005 expref: 36 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.697537:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4adc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b005 expref: 35 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.697545:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff907105cff400) 00010000:00010000:2.0:1787893030.697547:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787893030.697565:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9ec00, rc 0) 00000100:00100000:2.0:1787893030.697632:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f534000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+35:10527:x1874741431419136:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 410us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893030.697639:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 97 00000100:00100000:0.0:1787893030.704422:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893030.705327:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431419392 00000100:00100000:1.0:1787893030.705344:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431419392 00000100:00100000:1.0:1787893030.705475:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 98 00000100:00100000:1.0:1787893030.705487:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+35:10527:x1874741431419392:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:1.0:1787893030.705512:0:8281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893030.705533:0:8281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4adc9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b00c expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.705639:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4add0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.705653:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4add0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.705665:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4add0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893030.705692:0:8281:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787893030.705874:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4adc9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b00c expref: 38 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.705898:0:8281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4add0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b00c expref: 37 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.705907:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9071063d7d00) 00010000:00010000:1.0:1787893030.705910:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787893030.705913:0:8281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90710153b600, rc 0) 00000100:00100000:1.0:1787893030.707102:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+37:10527:x1874741431419392:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 1609us (2684us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1787893030.707113:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 98 00000100:00100000:1.0:1787893030.715294:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893030.715341:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893030.715573:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431419520 00000100:00100000:3.0:1787893030.715584:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431419520 00000100:00100000:3.0:1787893030.715702:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 6 00000100:00100000:3.0:1787893030.715714:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712eb54e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4829748d-dde1-497a-9623-0e4326f0972c+37:2363:x1874741431419520:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787893030.715730:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893030.715775:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4add0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b00c expref: 37 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.715797:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9071063d7d00) 00010000:00010000:3.0:1787893030.715803:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893030.715869:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712eb54e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4829748d-dde1-497a-9623-0e4326f0972c+36:2363:x1874741431419520:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 156us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893030.715877:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 6 00000100:00100000:2.0:1787893030.716126:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431419776 00000100:00100000:2.0:1787893030.716132:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431419776 00000100:00100000:2.0:1787893030.716900:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 99 00000100:00100000:2.0:1787893030.716911:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712eb56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+36:10527:x1874741431419776:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:2.0:1787893030.716995:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893030.717016:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4adde lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b013 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.717105:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4ade5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.717115:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4ade5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.717123:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4ade5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893030.717131:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787893030.717405:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4adde lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b013 expref: 39 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.717419:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4ade5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b013 expref: 38 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.717425:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9071063d7d00) 00010000:00010000:2.0:1787893030.717440:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787893030.717443:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9ee00, rc 0) 00000100:00100000:2.0:1787893030.717514:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712eb56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+38:10527:x1874741431419776:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 604us (2172us total) trans 4294967380 rc 0/0 00000100:00100000:2.0:1787893030.717521:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 99 00000100:00100000:1.0:1787893030.721968:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893030.722066:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431419904 00000100:00100000:2.0:1787893030.722075:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431419904 00000100:00100000:2.0:1787893030.722125:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 36 00000100:00100000:2.0:1787893030.722136:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712eb56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4829748d-dde1-497a-9623-0e4326f0972c+6:2361:x1874741431419904:12345-192.168.202.29@tcp:1:lfs.0 00010000:00010000:2.0:1787893030.722197:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001444a258/0x825e3f5022b4adf3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.722215:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000897fec43/0x825e3f5022b4adb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821affe expref: 6 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.722221:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893030.722224:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787893030.722227:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001444a258/0x825e3f5022b4adf3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.722264:0:6700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000897fec43/0x825e3f5022b4adb4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821affe expref: 6 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.722282:0:6700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000897fec43/0x825e3f5022b4adb4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821affe expref: 6 pid: 6701 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893030.722300:0:6700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907108386d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6700:1874741455555200:192.168.202.29@tcp:104: 00000100:00100000:2.0:1787893030.722425:0:6700:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071102973c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787893030.725303:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893030.725626:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431420032 00000100:00100000:3.0:1787893030.725637:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431420032 00002000:00100000:3.0:1787893030.725689:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff90712e2f3100 x1874741431420032/t0(0) o4->4829748d-dde1-497a-9623-0e4326f0972c@192.168.202.29@tcp:191/0 lens 504/0 e 0 to 0 dl 1787893041 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787893030.725706:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90712e2f3100 with x1874741431420032 ext(0->8) 00010000:00010000:3.0:1787893030.725715:0:6706:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000897fec43/0x825e3f5022b4adb4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821affe expref: 7 pid: 6701 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.725730:0:6706:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000897fec43/0x825e3f5022b4adb4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821affe expref: 7 pid: 6701 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893030.725735:0:6700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907108386d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6700:1874741455555200:192.168.202.29@tcp:104: 00002000:00010000:3.0:1787893030.725771:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90712e2f3100 00010000:00010000:2.0:1787893030.725787:0:6700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001444a258/0x825e3f5022b4adf3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893030.725880:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1 00000100:00100000:3.0:1787893030.725891:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4829748d-dde1-497a-9623-0e4326f0972c+7:2361:x1874741431420032:12345-192.168.202.29@tcp:4:lfs.0 00000100:00100000:3.0:1787893030.726623:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4829748d-dde1-497a-9623-0e4326f0972c+9:2361:x1874741431420032:12345-192.168.202.29@tcp:4:lfs.0 Request processed in 728us (1333us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787893030.726632:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1 00002000:00100000:3.0:1787893030.726640:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff90712e2f3100 x1874741431420032/t4294967302(0) o4->4829748d-dde1-497a-9623-0e4326f0972c@192.168.202.29@tcp:191/0 lens 504/448 e 0 to 0 dl 1787893041 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787893030.726649:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90712e2f3100 with x1874741431420032 ext(0->8) 00010000:00010000:3.0:1787893030.726655:0:6706:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000897fec43/0x825e3f5022b4adb4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821affe expref: 9 pid: 6701 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.726668:0:6706:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000897fec43/0x825e3f5022b4adb4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821affe expref: 9 pid: 6701 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787893030.726675:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90712e2f3100 00000100:00100000:1.0:1787893030.732394:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893030.732490:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431420160 00000100:00100000:2.0:1787893030.732500:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431420160 00010000:00010000:2.0:1787893030.732553:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000897fec43/0x825e3f5022b4adb4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821affe expref: 9 pid: 6701 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893030.732597:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 50 00000100:00100000:2.0:1787893030.732604:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712eb55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4829748d-dde1-497a-9623-0e4326f0972c+9:2360:x1874741431420160:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787893030.732617:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787893030.732633:0:5834:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787893030.732635:0:5834:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787893030 00002000:00010000:2.0:1787893030.732637:0:5834:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787893030 00002000:00010000:2.0:1787893030.732638:0:5834:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787893030 00010000:00010000:2.0:1787893030.732643:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000897fec43/0x825e3f5022b4adb4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821affe expref: 9 pid: 6701 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.732653:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000897fec43/0x825e3f5022b4adb4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821affe expref: 9 pid: 6701 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.732673:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000897fec43/0x825e3f5022b4adb4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821affe expref: 9 pid: 6701 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.732704:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787893030.732707:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787893030.732712:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001444a258/0x825e3f5022b4adf3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.732720:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001444a258/0x825e3f5022b4adf3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.732748:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787893030.733126:0:6700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001444a258/0x825e3f5022b4adf3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.733134:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001444a258/0x825e3f5022b4adf3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.733206:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001444a258/0x825e3f5022b4adf3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.733218:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001444a258/0x825e3f5022b4adf3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.733223:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001444a258/0x825e3f5022b4adf3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.733227:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9fc00 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:3.0:1787893030.733230:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001444a258/0x825e3f5022b4adf3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.733235:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001444a258/0x825e3f5022b4adf3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.733243:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001444a258/0x825e3f5022b4adf3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.733249:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001444a258/0x825e3f5022b4adf3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893030.733327:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712eb56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4829748d-dde1-497a-9623-0e4326f0972c+8:2361:x1874741431419904:12345-192.168.202.29@tcp:1:lfs.0 Request processed in 11192us (11368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893030.733337:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 36 00000100:00100000:2.0:1787893030.733659:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712eb55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4829748d-dde1-497a-9623-0e4326f0972c+7:2360:x1874741431420160:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 1054us (1272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893030.733665:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 50 00000100:00100000:1.0:1787893030.740129:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893030.740281:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431420416 00000100:00100000:3.0:1787893030.740293:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431420416 00000100:00100000:3.0:1787893030.740356:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 26 00000100:00100000:3.0:1787893030.740377:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713044cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+38:10527:x1874741431420416:12345-192.168.202.29@tcp:35:lfs.0 00000004:00010000:3.0:1787893030.740458:0:5850:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4ade5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b013 expref: 38 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787893030.742710:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1787893030.742924:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:2.0:1787893030.743723:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00010000:00010000:2.0:1787893030.744066:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e000/0x825e3f5022b4adfa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.744090:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4ad9f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aff0 expref: 42 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.744098:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e000/0x825e3f5022b4adfa lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.744212:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4ad9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aff0 expref: 42 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.744245:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4ad9f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aff0 expref: 42 pid: 8281 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893030.744262:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907108386d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5850:1874741455555328:192.168.202.29@tcp:104: 00000100:00100000:2.0:1787893030.744422:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff907110297480 going to sleep for 11 seconds 00000100:00100000:2.0:1787893030.751298:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907108386d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5850:1874741455555328:192.168.202.29@tcp:104: 00000100:00100000:1.0:1787893030.751308:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00010000:00010000:2.0:1787893030.751329:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e000/0x825e3f5022b4adfa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893030.752083:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431420544 00000100:00100000:0.0:1787893030.752093:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431420544 00010000:00010000:0.0:1787893030.752137:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4ad9f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aff0 expref: 43 pid: 8281 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893030.752188:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 51 00000100:00100000:0.0:1787893030.752198:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712eb55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4829748d-dde1-497a-9623-0e4326f0972c+43:2360:x1874741431420544:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893030.752216:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893030.752223:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4ad9f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aff0 expref: 43 pid: 8281 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893030.752243:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4ad9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aff0 expref: 43 pid: 8281 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893030.752289:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4ad9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aff0 expref: 43 pid: 8281 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893030.752306:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9071063d7d00) 00010000:00010000:0.0:1787893030.752311:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e000/0x825e3f5022b4adfa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893030.752320:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e000/0x825e3f5022b4adfa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893030.752326:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e000/0x825e3f5022b4adfa lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893030.752358:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893030.752419:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712eb55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4829748d-dde1-497a-9623-0e4326f0972c+42:2360:x1874741431420544:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 222us (1110us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893030.752427:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 51 00010000:00010000:2.0:1787893030.752621:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e000/0x825e3f5022b4adfa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.752629:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e000/0x825e3f5022b4adfa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787893030.752812:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:2.0:1787893030.753056:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1787893030.753172:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907108386d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5850:1874741455555456:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787893030.753222:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893030.753302:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff907103ede780 going to sleep for 11 seconds 00000100:00100000:3.0:1787893030.755314:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455555456 00000100:00100000:3.0:1787893030.755330:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455555456 00000100:00100000:0.0:1787893030.755723:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787893030.755734:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907108387100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1874741455555456:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787893030.755879:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907108387100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1874741455555456:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 147us (2657us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893030.755887:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787893030.755912:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907108386d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5850:1874741455555456:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787893030.757348:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:2.0:1787893030.757458:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907108386d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5850:1874741455555584:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787893030.757585:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893030.757624:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff907139cdec00 going to sleep for 11 seconds 00000100:00100000:3.0:1787893030.757697:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455555584 00000100:00100000:3.0:1787893030.757705:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455555584 00000100:00100000:3.0:1787893030.757887:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787893030.758054:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907108384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5850:x1874741455555584:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787893030.758443:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907108384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5850:x1874741455555584:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 545us (857us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787893030.758451:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787893030.758581:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907108386d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5850:1874741455555584:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787893030.758646:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1787893030.758692:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e000/0x825e3f5022b4adfa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.758704:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e000/0x825e3f5022b4adfa lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.758726:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e000/0x825e3f5022b4adfa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.758732:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9e000 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893030.758738:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e000/0x825e3f5022b4adfa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.758745:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e000/0x825e3f5022b4adfa lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.760117:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9071063d7d00) 00010000:00010000:1.0:1787893030.760127:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787893030.760134:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e000/0x825e3f5022b4adfa lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.760213:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e000/0x825e3f5022b4adfa lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787893030.761085:0:5850:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787893030.761937:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1787893030.761956:0:5850:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 358529203207ns, next at 359529199237ns, rc = 0 00000001:00080000:1.0:1787893030.761972:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:1.0:1787893030.762040:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9071063d7d00) 00010000:00010000:1.0:1787893030.762045:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787893030.762056:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4ade5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b013 expref: 46 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893030.762227:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713044cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+45:10527:x1874741431420416:12345-192.168.202.29@tcp:35:lfs.0 Request processed in 21850us (22103us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1787893030.762266:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 26 00000020:00080000:1.0:1787893030.762273:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787893030.768219:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893030.768354:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431420672 00000100:00100000:3.0:1787893030.768365:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431420672 00000100:00100000:3.0:1787893030.768450:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 100 00000100:00100000:3.0:1787893030.768472:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712eb55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+45:10527:x1874741431420672:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:3.0:1787893030.768499:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893030.768524:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4ae01 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b01a expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.768586:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4ae01 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b01a expref: 46 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.768600:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4ae01 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b01a expref: 46 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.768619:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9071063d7500) 00010000:00010000:3.0:1787893030.768623:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787893030.768627:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907104f46000, rc 0) 00000100:00100000:3.0:1787893030.768696:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712eb55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+46:10527:x1874741431420672:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 236us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893030.768721:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 100 00000100:00100000:0.0:1787893030.778505:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893030.779837:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431420928 00000100:00100000:1.0:1787893030.779848:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431420928 00000100:00100000:1.0:1787893030.780413:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 27 00000100:00100000:1.0:1787893030.780428:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+46:10527:x1874741431420928:12345-192.168.202.29@tcp:35:lfs.0 00000100:00100000:1.0:1787893030.780703:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+47:10527:x1874741431420928:12345-192.168.202.29@tcp:35:lfs.0 Request processed in 277us (2210us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1787893030.780709:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 27 00000100:00100000:0.0:1787893030.877024:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893030.877080:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431421056 00000100:00100000:3.0:1787893030.877089:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431421056 00000100:00100000:3.0:1787893030.877175:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 101 00000100:00100000:3.0:1787893030.877183:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+47:10537:x1874741431421056:12345-192.168.202.29@tcp:34:lfs.0 00010000:00010000:3.0:1787893030.877259:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ae08 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.877274:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ae08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.877282:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ae08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.877293:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4ae0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.877298:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4ae0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.877301:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4ae0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.877381:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4ae16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.877386:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4ae16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.877389:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4ae16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787893030.877441:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4ae16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.877453:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ae08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.877459:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ae08 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.877482:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ae08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.877488:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f47c00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893030.877492:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ae08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.877499:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ae08 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.877511:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff907105cff400) 00010000:00010000:3.0:1787893030.877513:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893030.877518:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ae08 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.877524:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ae08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.877537:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4ae0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.877553:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4ae0f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.877566:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4ae0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.877570:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f47800 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893030.877573:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4ae0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.877580:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4ae0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.877588:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9071063d7d00) 00010000:00010000:3.0:1787893030.877591:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893030.877594:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4ae0f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.877599:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4ae0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.877610:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4ae16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.877614:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4ae16 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.877617:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4ae16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.877621:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f46200 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893030.877622:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4ae16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.877635:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4ae16 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.877640:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9071063d7500) 00010000:00010000:3.0:1787893030.877642:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893030.877643:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4ae16 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893030.877647:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4ae16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893030.877710:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+47:10537:x1874741431421056:12345-192.168.202.29@tcp:34:lfs.0 Request processed in 527us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893030.877715:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 101 00000100:00100000:3.0:1787893030.914948:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893030.915354:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431421312 00000100:00100000:1.0:1787893030.915370:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431421312 00000100:00100000:1.0:1787893030.915442:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 102 00000100:00100000:1.0:1787893030.915453:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f537480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+47:10540:x1874741431421312:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:1.0:1787893030.915485:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893030.915507:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ac00/0x825e3f5022b4ae1d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b021 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.915588:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4ae24 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.915614:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4ae24 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.915626:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4ae24 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.915644:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4ae2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.915667:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4ae2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.915675:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4ae2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.915861:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4ae32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.915870:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4ae32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.915877:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4ae32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893030.915886:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787893030.915992:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4ae24 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.916001:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4ae24 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.916008:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4ae24 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.916014:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153be00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893030.916018:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4ae24 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.916026:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4ae24 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.916050:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff907105cff400) 00010000:00010000:1.0:1787893030.916053:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893030.916058:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4ae24 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.916064:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4ae24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.916082:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4ae2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.916087:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4ae2b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.916092:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4ae2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.916097:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153ba00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893030.916099:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4ae2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.916105:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4ae2b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.916111:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff907105907300) 00010000:00010000:1.0:1787893030.916113:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893030.916115:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4ae2b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.916120:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4ae2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.916663:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ac00/0x825e3f5022b4ae1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b021 expref: 50 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.917720:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4ae32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b021 expref: 49 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893030.917735:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9071063d7500) 00010000:00010000:1.0:1787893030.917737:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787893030.917741:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90710153bc00, rc 0) 00000100:00100000:1.0:1787893030.917895:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f537480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+49:10540:x1874741431421312:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 2441us (2954us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1787893030.917904:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 102 00000100:00100000:0.0:1787893030.924944:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893030.925024:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431421440 00000100:00100000:2.0:1787893030.925033:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431421440 00000100:00100000:2.0:1787893030.925091:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 103 00000100:00100000:2.0:1787893030.925101:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+49:10540:x1874741431421440:12345-192.168.202.29@tcp:54:lfs.0 00010000:00010000:2.0:1787893030.925168:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4ae40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.925196:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4ae40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.925208:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4ae40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.925234:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4ae40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.925241:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4ae40 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.925248:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4ae40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.925254:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9e200 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893030.925258:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4ae40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.925266:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4ae40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.925292:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9071063d7500) 00010000:00010000:2.0:1787893030.925295:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787893030.925300:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4ae40 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893030.925306:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4ae40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893030.925377:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+49:10540:x1874741431421440:12345-192.168.202.29@tcp:54:lfs.0 Request processed in 278us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893030.925385:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 103 00000100:00100000:2.0:1787893030.937587:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893030.937959:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431421696 00000100:00100000:1.0:1787893030.937972:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431421696 00000100:00100000:1.0:1787893030.938038:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 28 00000100:00100000:1.0:1787893030.938051:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907108385c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+49:10540:x1874741431421696:12345-192.168.202.29@tcp:35:lfs.0 00000100:00100000:1.0:1787893030.938307:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907108385c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+50:10540:x1874741431421696:12345-192.168.202.29@tcp:35:lfs.0 Request processed in 259us (784us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1787893030.938316:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 28 00010000:00010000:3.0:1787893030.987782:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893031.066145:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893031.070976:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431421952 00000100:00100000:3.0:1787893031.070995:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431421952 00000100:00100000:3.0:1787893031.071100:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 104 00000100:00100000:3.0:1787893031.071111:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712eb54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+50:10550:x1874741431421952:12345-192.168.202.29@tcp:101:bash.0 00000100:00080000:1.0:1787893031.071133:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787893031.071146:0:8281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893031.071150:0:8281:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787893031.071179:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4adc2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b005 expref: 50 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893031.071204:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff907105cff400) 00010000:00010000:3.0:1787893031.071208:0:8281:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787893031.071224:0:8281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4ae47 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b028 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893031.071354:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4ae4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893031.071367:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4ae4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893031.071377:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4ae4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893031.071388:0:8281:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787893031.071538:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4ae47 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b028 expref: 52 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893031.071552:0:8281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4ae4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b028 expref: 51 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893031.071559:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9071063d7500) 00010000:00010000:3.0:1787893031.071561:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787893031.071563:0:8281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907104f47800, rc 0) 00000100:00100000:3.0:1787893031.071648:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712eb54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+51:10550:x1874741431421952:12345-192.168.202.29@tcp:101:bash.0 Request processed in 539us (5512us total) trans 4294967393 rc 0/0 00000100:00100000:3.0:1787893031.071656:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 104 00000100:00100000:0.0:1787893031.080857:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893031.080910:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893031.081025:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431422080 00000100:00100000:2.0:1787893031.081036:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431422080 00000100:00100000:2.0:1787893031.081103:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 7 00000100:00100000:2.0:1787893031.081114:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4829748d-dde1-497a-9623-0e4326f0972c+51:2361:x1874741431422080:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787893031.081139:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893031.081168:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4ae4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b028 expref: 51 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.081193:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9071063d7500) 00010000:00010000:2.0:1787893031.081199:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893031.081271:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4829748d-dde1-497a-9623-0e4326f0972c+50:2361:x1874741431422080:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 158us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893031.081278:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 7 00000100:00100000:3.0:1787893031.081789:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431422336 00000100:00100000:3.0:1787893031.081797:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431422336 00000100:00100000:3.0:1787893031.081839:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 105 00000100:00100000:3.0:1787893031.081846:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+50:10550:x1874741431422336:12345-192.168.202.29@tcp:36:bash.0 00010000:00010000:3.0:1787893031.081925:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893031.081952:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4ae32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b021 expref: 50 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893031.081970:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9071063d7500) 00010000:00010000:3.0:1787893031.081974:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787893031.082587:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ae5c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893031.082602:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ae5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893031.082611:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ae5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787893031.082664:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967394 00000004:00010000:3.0:1787893031.082693:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000f80aee3 reply state 00000000495211ac transno 4294967395 ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ae5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893031.082702:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787893031.093641:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+52:10550:x1874741431422336:12345-192.168.202.29@tcp:36:bash.0 Request processed in 11771us (12706us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1787893031.093687:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 105 00000020:00080000:2.0:1787893031.093700:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787893031.100707:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00010000:00010000:1.0:1787893031.101035:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ae5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893031.101049:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ae5c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893031.101082:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ae5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893031.101088:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f47c00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893031.101093:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ae5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893031.101101:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ae5c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893031.101119:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9071063d7500) 00010000:00010000:1.0:1787893031.101123:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893031.101128:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ae5c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893031.101134:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4ae5c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893031.102613:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431422464 00000100:00100000:3.0:1787893031.102627:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431422464 00000100:00100000:3.0:1787893031.102701:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 106 00000100:00100000:0.0:1787893031.102842:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+51:10550:x1874741431422464:12345-192.168.202.29@tcp:101:bash.0 00010000:00010000:0.0:1787893031.102867:0:8281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893031.102886:0:8281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4ae63 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b02f expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893031.102968:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4ae6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893031.102979:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4ae6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893031.102987:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4ae6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893031.103008:0:8281:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787893031.103011:0:8281:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787893031.103026:0:8281:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4ae6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893031.103045:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4ae63 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b02f expref: 53 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893031.103057:0:8281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4ae6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b02f expref: 52 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893031.103063:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9071063d7500) 00010000:00010000:0.0:1787893031.103065:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787893031.103067:0:8281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907137fc8400, rc 0) 00000100:00100000:0.0:1787893031.103119:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+52:10550:x1874741431422464:12345-192.168.202.29@tcp:101:bash.0 Request processed in 409us (2421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893031.103137:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 106 00000100:00100000:0.0:1787893031.105968:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893031.106041:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431422720 00000100:00100000:1.0:1787893031.106051:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431422720 00000100:00100000:1.0:1787893031.106115:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 29 00000100:00100000:1.0:1787893031.106126:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+52:10550:x1874741431422720:12345-192.168.202.29@tcp:35:bash.0 00000100:00100000:1.0:1787893031.106400:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+53:10550:x1874741431422720:12345-192.168.202.29@tcp:35:bash.0 Request processed in 273us (441us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1787893031.106418:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 29 00000100:00100000:1.0:1787893031.114287:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f537b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455555712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787893031.114364:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893031.114563:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455555712 00000100:00100000:3.0:1787893031.114572:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455555712 00000100:00100000:3.0:1787893031.114644:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787893031.114654:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712eb56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874741455555712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787893031.114690:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787893031.114777:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712eb56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874741455555712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893031.114784:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787893031.114882:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f537b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455555712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787893031.199582:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893031.199841:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431422848 00000100:00100000:3.0:1787893031.199888:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431422848 00000100:00100000:3.0:1787893031.199972:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 107 00000100:00100000:3.0:1787893031.199984:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907108384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+53:10556:x1874741431422848:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:3.0:1787893031.200015:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893031.200041:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4ae71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b036 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893031.200128:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46800/0x825e3f5022b4ae78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893031.200146:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46800/0x825e3f5022b4ae78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893031.200161:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46800/0x825e3f5022b4ae78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893031.200243:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1787893031.200248:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787893031.200278:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46800/0x825e3f5022b4ae78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893031.200310:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4ae71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b036 expref: 55 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893031.200333:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46800/0x825e3f5022b4ae78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b036 expref: 54 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893031.200343:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff907105cff400) 00010000:00010000:3.0:1787893031.200346:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787893031.200351:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907104f46800, rc 0) 00000100:00100000:3.0:1787893031.200911:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907108384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+54:10556:x1874741431422848:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 467us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893031.200921:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 107 00000100:00100000:0.0:1787893031.210973:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893031.211383:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431422976 00000100:00100000:2.0:1787893031.211399:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431422976 00000100:00100000:2.0:1787893031.211512:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 108 00000100:00100000:2.0:1787893031.211526:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+54:10556:x1874741431422976:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:2.0:1787893031.211556:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893031.211586:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4ae7f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b03d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.211674:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4ae86 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.211697:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4ae86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.211711:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4ae86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.211728:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fa00/0x825e3f5022b4ae8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.211735:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fa00/0x825e3f5022b4ae8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.211742:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fa00/0x825e3f5022b4ae8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.212100:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e600/0x825e3f5022b4ae94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.212129:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e600/0x825e3f5022b4ae94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.212137:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e600/0x825e3f5022b4ae94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893031.212191:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787893031.212197:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787893031.212222:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e600/0x825e3f5022b4ae94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.212236:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e600/0x825e3f5022b4ae94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.212246:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4ae86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.212254:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4ae86 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.212261:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4ae86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.212268:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9e400 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893031.212274:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4ae86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.212283:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4ae86 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.212299:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff907105cff400) 00010000:00010000:2.0:1787893031.212302:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893031.212316:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4ae86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.212323:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4ae86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.212340:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fa00/0x825e3f5022b4ae8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.212347:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fa00/0x825e3f5022b4ae8d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.212352:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fa00/0x825e3f5022b4ae8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.212357:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9fa00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893031.212360:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fa00/0x825e3f5022b4ae8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.212366:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fa00/0x825e3f5022b4ae8d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.212374:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff907105cff800) 00010000:00010000:2.0:1787893031.212376:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893031.212379:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fa00/0x825e3f5022b4ae8d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.212385:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fa00/0x825e3f5022b4ae8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.212424:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4ae7f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b03d expref: 56 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.212454:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e600/0x825e3f5022b4ae94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b03d expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.212628:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9071063d7500) 00010000:00010000:2.0:1787893031.212631:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787893031.212634:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9e600, rc 0) 00000100:00100000:2.0:1787893031.212828:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+55:10556:x1874741431422976:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 1303us (1866us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893031.212837:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 108 00000100:00100000:0.0:1787893031.229231:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893031.229409:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431423232 00000100:00100000:3.0:1787893031.229435:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431423232 00000100:00100000:3.0:1787893031.229545:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 109 00000100:00100000:3.0:1787893031.229559:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+55:10556:x1874741431423232:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:3.0:1787893031.229592:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893031.229622:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4ae9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b044 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893031.229820:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4aea2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893031.229841:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4ae6a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b02f expref: 56 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893031.229852:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e600/0x825e3f5022b4ae94 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b03d expref: 56 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893031.229862:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4aea2 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893031.229921:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e600/0x825e3f5022b4ae94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b03d expref: 56 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893031.229937:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e600/0x825e3f5022b4ae94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b03d expref: 56 pid: 5847 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893031.229977:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f534e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1874741455555840:192.168.202.29@tcp:104: 00010000:00010000:3.0:1787893031.230117:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4ae6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b02f expref: 56 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893031.230127:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4ae6a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b02f expref: 56 pid: 8281 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893031.230137:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f537b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1874741455555968:192.168.202.29@tcp:104: 00000100:00100000:3.0:1787893031.230177:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071052b5900 going to sleep for 11 seconds 00000100:00100000:1.0:1787893031.232482:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893031.232806:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431423360 00000100:00100000:0.0:1787893031.232819:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431423360 00010000:00010000:0.0:1787893031.232880:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e600/0x825e3f5022b4ae94 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b03d expref: 57 pid: 5847 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893031.232928:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 52 00000100:00100000:0.0:1787893031.232940:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712eb57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4829748d-dde1-497a-9623-0e4326f0972c+57:2361:x1874741431423360:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893031.232959:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893031.232968:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e600/0x825e3f5022b4ae94 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b03d expref: 57 pid: 5847 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893031.232984:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e600/0x825e3f5022b4ae94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b03d expref: 57 pid: 5847 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893031.233015:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9071063d7500) 00010000:00010000:0.0:1787893031.233022:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4aea2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893031.233033:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4aea2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893031.233040:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893031.233120:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712eb57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4829748d-dde1-497a-9623-0e4326f0972c+57:2361:x1874741431423360:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 182us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893031.233129:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 52 00000100:00100000:0.0:1787893031.239947:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00010000:00010000:2.0:1787893031.240105:0:5849:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.29@tcp) returned -22 from blocking AST (req@0000000057a84d80 x1874741455555840) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e600/0x825e3f5022b4ae94 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b03d expref: 56 pid: 5847 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.240135:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e600/0x825e3f5022b4ae94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b03d expref: 56 pid: 5847 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893031.240158:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f534e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1874741455555840:192.168.202.29@tcp:104: 00000100:00100000:2.0:1787893031.240175:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f537b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1874741455555968:192.168.202.29@tcp:104: 00010000:00010000:2.0:1787893031.240206:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9071063d7500) 00010000:00010000:2.0:1787893031.240212:0:5849:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4aea2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.240224:0:5849:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4aea2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.240235:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4aea2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893031.244031:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431423488 00000100:00100000:1.0:1787893031.244054:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431423488 00010000:00010000:1.0:1787893031.244129:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4ae6a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b02f expref: 56 pid: 8281 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893031.244175:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 53 00000100:00100000:1.0:1787893031.244187:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4829748d-dde1-497a-9623-0e4326f0972c+56:2361:x1874741431423488:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893031.244209:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893031.244217:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4ae6a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b02f expref: 56 pid: 8281 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893031.244231:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4ae6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b02f expref: 56 pid: 8281 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893031.244257:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4ae6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b02f expref: 56 pid: 8281 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893031.244275:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9071063d7500) 00010000:00010000:1.0:1787893031.244279:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4aea2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893031.244287:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4aea2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893031.244293:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4aea2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893031.244320:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787893031.244357:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4aea2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.244370:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4aea2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893031.244396:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000100:00100000:1.0:1787893031.244933:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4829748d-dde1-497a-9623-0e4326f0972c+56:2361:x1874741431423488:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 513us (4765us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893031.244966:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 53 00010000:00010000:2.0:1787893031.245200:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4ae9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b044 expref: 56 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.245229:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4aea2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b044 expref: 55 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.245237:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9071063d7500) 00010000:00010000:2.0:1787893031.245240:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787893031.245243:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907104f47c00, rc 0) 00000100:00100000:2.0:1787893031.245346:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+55:10556:x1874741431423232:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 15788us (16132us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1787893031.245354:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 109 00000100:00100000:0.0:1787893031.249389:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893031.249588:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431423744 00000100:00100000:2.0:1787893031.249603:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431423744 00000100:00100000:2.0:1787893031.249684:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 8 00000100:00100000:2.0:1787893031.249695:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107fa4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4829748d-dde1-497a-9623-0e4326f0972c+55:10556:x1874741431423744:12345-192.168.202.29@tcp:103:lfs.0 00010000:00010000:2.0:1787893031.249714:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893031.249744:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4ae01 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b01a expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.249985:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9071063d7500) 00010000:00010000:2.0:1787893031.249991:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893031.250093:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107fa4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4829748d-dde1-497a-9623-0e4326f0972c+54:10556:x1874741431423744:12345-192.168.202.29@tcp:103:lfs.0 Request processed in 399us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893031.250103:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 8 00000100:00100000:0.0:1787893031.270316:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893031.270502:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431423872 00000100:00100000:1.0:1787893031.270517:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431423872 00000100:00100000:1.0:1787893031.270601:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 110 00000100:00100000:1.0:1787893031.270613:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+54:10556:x1874741431423872:12345-192.168.202.29@tcp:58:lfs.0 00010000:00010000:1.0:1787893031.270832:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4aeb0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893031.270855:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4aeb0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893031.270879:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4aeb0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787893031.271447:0:8281:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1787893031.271576:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+54:10556:x1874741431423872:12345-192.168.202.29@tcp:58:lfs.0 Request processed in 962us (1275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893031.271586:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 110 00000100:00100000:3.0:1787893031.290812:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893031.291048:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431424000 00000100:00100000:2.0:1787893031.291077:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431424000 00000100:00100000:2.0:1787893031.291182:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 111 00000100:00100000:2.0:1787893031.291197:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+54:10556:x1874741431424000:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:2.0:1787893031.291230:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893031.291261:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e600/0x825e3f5022b4aeb7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b04b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.291539:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4aeb0 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.291556:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e600/0x825e3f5022b4aeb7 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b04b expref: 55 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.291585:0:5848:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4aeb0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.291604:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e600/0x825e3f5022b4aeb7 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b04b expref: 55 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.291622:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9071063d7500) 00010000:00010000:2.0:1787893031.291644:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787893031.291649:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e600/0x825e3f5022b4aeb7 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b04b expref: 55 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.291657:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9e600, rc 0) 00000100:00100000:2.0:1787893031.291852:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+55:10556:x1874741431424000:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 657us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893031.291862:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 111 00000040:00080000:1.0:1787893031.881125:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787893031.881141:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787893031.881222:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1787893031.881232:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787893031.881419:0:11693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712eb55c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1874741455556096:192.168.202.29@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787893031.882134:0:11693:0:(client.c:2715:ptlrpc_set_wait()) set ffff90711b9730c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787893031.884877:0:11693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712eb55c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1874741455556096:192.168.202.29@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787893031.889095:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893031.889354:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431424128 00000100:00100000:1.0:1787893031.889367:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431424128 00000100:00100000:1.0:1787893031.889894:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 112 00000100:00100000:1.0:1787893031.889907:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+55:10557:x1874741431424128:12345-192.168.202.29@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787893031.889959:0:8281:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787893031.890095:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+55:10557:x1874741431424128:12345-192.168.202.29@tcp:53:lhsmtool_posix.0 Request processed in 191us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893031.890104:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 112 00000100:00100000:3.0:1787893031.892745:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893031.892868:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431424256 00000100:00100000:2.0:1787893031.892882:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431424256 00000100:00100000:2.0:1787893031.892961:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 113 00000100:00100000:2.0:1787893031.892973:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f534700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+55:10557:x1874741431424256:12345-192.168.202.29@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787893031.893067:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fa00/0x825e3f5022b4aebe lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.893089:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fa00/0x825e3f5022b4aebe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.893103:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fa00/0x825e3f5022b4aebe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.893120:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4aec5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.893127:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4aec5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.893134:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4aec5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.893158:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4aecc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.893188:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4aecc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.893196:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4aecc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893031.893247:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787893031.893251:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787893031.893268:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4aecc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.893282:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fa00/0x825e3f5022b4aebe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.893290:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fa00/0x825e3f5022b4aebe lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.893298:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fa00/0x825e3f5022b4aebe lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.893305:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9fa00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893031.893309:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fa00/0x825e3f5022b4aebe lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.893317:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fa00/0x825e3f5022b4aebe lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.893331:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9071061f7700) 00010000:00010000:2.0:1787893031.893334:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893031.893534:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fa00/0x825e3f5022b4aebe lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.893553:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fa00/0x825e3f5022b4aebe lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.893571:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4aec5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.893577:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4aec5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.893583:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4aec5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.893588:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9e400 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893031.893591:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4aec5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.893597:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4aec5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.893605:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff907105cff800) 00010000:00010000:2.0:1787893031.893607:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893031.893610:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4aec5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.893616:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4aec5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.893631:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4aecc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.893637:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4aecc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.893646:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4aecc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.893652:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9fe00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893031.893655:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4aecc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.893660:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4aecc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.893667:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9071063d7500) 00010000:00010000:2.0:1787893031.893669:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893031.893671:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4aecc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.893676:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4aecc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893031.893851:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f534700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+55:10557:x1874741431424256:12345-192.168.202.29@tcp:34:lhsmtool_posix.0 Request processed in 878us (1119us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893031.893859:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 113 00000100:00100000:0.0:1787893031.897282:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893031.897446:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431424512 00000100:00100000:2.0:1787893031.897470:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431424512 00000100:00100000:2.0:1787893031.897551:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 114 00000100:00100000:2.0:1787893031.897563:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+55:10557:x1874741431424512:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787893031.897590:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893031.897616:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4aed3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b052 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.897805:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4aeda lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.897833:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4aeda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.897847:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4aeda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893031.897861:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787893031.898005:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4aeda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.898013:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4aeda lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.898021:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4aeda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.898027:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9e800 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893031.898032:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4aeda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.898041:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4aeda lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.898056:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9071063d7500) 00010000:00010000:2.0:1787893031.898059:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787893031.898065:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4aeda lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.898085:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4aeda lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.898143:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4aed3 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b052 expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.898156:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9071061f7700) 00010000:00010000:2.0:1787893031.898158:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787893031.898162:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4aed3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b052 expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.898174:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9f400, rc 0) 00000100:00100000:2.0:1787893031.898264:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+56:10557:x1874741431424512:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 Request processed in 702us (997us total) trans 4294967398 rc 301/301 00000100:00100000:2.0:1787893031.898272:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 114 00000100:00100000:0.0:1787893031.916094:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893031.916276:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431424640 00000100:00100000:2.0:1787893031.916290:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431424640 00000100:00100000:2.0:1787893031.916386:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 115 00000100:00100000:2.0:1787893031.916400:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+56:10557:x1874741431424640:12345-192.168.202.29@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787893031.916466:0:5848:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787893031.924796:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+56:10557:x1874741431424640:12345-192.168.202.29@tcp:53:lhsmtool_posix.0 Request processed in 8378us (8698us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893031.925066:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 115 00000100:00100000:3.0:1787893031.938115:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893031.938707:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431424896 00000100:00100000:2.0:1787893031.938725:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431424896 00000100:00100000:2.0:1787893031.938879:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 116 00000100:00100000:2.0:1787893031.938911:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f537800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+56:10557:x1874741431424896:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787893031.938942:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893031.938957:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787893031.938996:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46800/0x825e3f5022b4ae78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b036 expref: 56 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893031.939022:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff907105cff400) 00010000:00010000:2.0:1787893031.939028:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787893031.939048:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4aee8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b059 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787893031.963049:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1787893031.963869:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4aeef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893031.963894:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4aeef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893031.963909:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4aeef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893031.964014:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4aee8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b059 expref: 58 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893031.964038:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4aeef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b059 expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893031.964068:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9071063d7d00) 00010000:00010000:3.0:1787893031.964071:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787893031.964075:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907104f47800, rc 0) 00000100:00100000:3.0:1787893031.964185:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f537800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+57:10557:x1874741431424896:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 Request processed in 25275us (26088us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1787893031.964196:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 116 00000100:00100000:0.0:1787893031.970180:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893031.970342:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431425152 00000100:00100000:3.0:1787893031.970357:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431425152 00000100:00100000:3.0:1787893031.970441:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 117 00000100:00100000:3.0:1787893031.970462:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+57:10557:x1874741431425152:12345-192.168.202.29@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787893031.970547:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893031.970582:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4aeef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b059 expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893031.970607:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9071063d7d00) 00010000:00010000:3.0:1787893031.970621:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787893031.970648:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4aefd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893031.970663:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4aefd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893031.970674:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4aefd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893031.974152:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4af04 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x6b9b2524 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893031.975911:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4af04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x6b9b2524 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893031.977169:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4af04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x6b9b2524 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893031.977287:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4aefd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893031.977296:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4aefd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893031.977305:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4aefd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893031.977312:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f47200 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893031.977317:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4aefd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893031.977325:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4aefd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893031.977342:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff907105cff400) 00010000:00010000:3.0:1787893031.977345:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893031.977350:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4aefd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893031.977357:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4aefd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893031.977371:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4af04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x6b9b2524 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893031.977389:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4af04 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6b9b2524 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893031.977395:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4af04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6b9b2524 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893031.977401:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f47e00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893031.977404:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4af04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6b9b2524 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893031.977410:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4af04 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6b9b2524 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893031.977418:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x6b9b2524 (ffff9071063d7b00) 00010000:00010000:3.0:1787893031.977421:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893031.977424:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4af04 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x6b9b2524 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893031.977429:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4af04 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x6b9b2524 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893031.977572:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+56:10557:x1874741431425152:12345-192.168.202.29@tcp:36:lhsmtool_posix.0 Request processed in 7116us (7406us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787893031.977582:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 117 00000100:00100000:0.0:1787893031.980706:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893031.980819:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431425280 00000100:00100000:1.0:1787893031.980839:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431425280 00000100:00100000:1.0:1787893031.980934:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 118 00000100:00100000:1.0:1787893031.980959:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+56:10557:x1874741431425280:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787893031.980993:0:8281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893031.981028:0:8281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4af0b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b060 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893031.981082:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4af12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893031.981100:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4af12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893031.981114:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4af12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893031.992469:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4af0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b060 expref: 58 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893031.992683:0:8281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4af12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b060 expref: 57 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893031.992729:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff907105907300) 00010000:00010000:1.0:1787893031.992733:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787893031.992739:0:8281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90710153a000, rc 0) 00000100:00100000:1.0:1787893031.992880:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+57:10557:x1874741431425280:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 Request processed in 11931us (12184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893031.992891:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 118 00000100:00100000:1.0:1787893032.001744:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893032.003122:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431425536 00000100:00100000:2.0:1787893032.003154:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431425536 00000100:00100000:2.0:1787893032.003269:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 119 00000100:00100000:2.0:1787893032.003284:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712eb55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+57:10557:x1874741431425536:12345-192.168.202.29@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787893032.003438:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4af19 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.003471:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4af19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.003486:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4af19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787893032.003930:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:2.0:1787893032.003944:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 359771190737ns, next at 360771187049ns, rc = 0 00000004:00010000:2.0:1787893032.004083:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006e0ac939 reply state 00000000b9d7502c transno 4294967400 ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4af19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893032.004117:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787893032.004261:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712eb55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+59:10557:x1874741431425536:12345-192.168.202.29@tcp:36:lhsmtool_posix.0 Request processed in 979us (2531us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1787893032.004270:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 119 00010000:00010000:1.0:1787893032.006241:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4af19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893032.006262:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4af19 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893032.006270:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4af19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893032.006276:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9e800 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893032.006281:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4af19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893032.006288:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4af19 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893032.006304:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff907105907300) 00010000:00010000:1.0:1787893032.006307:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787893032.006311:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4af19 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893032.006336:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4af19 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893032.008054:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893032.010084:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431425664 00000100:00100000:3.0:1787893032.010106:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431425664 00000100:00100000:3.0:1787893032.010276:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 120 00000100:00100000:3.0:1787893032.010290:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712eb55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+58:10557:x1874741431425664:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787893032.010327:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893032.010607:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4af20 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b067 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.010701:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4af20 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b067 expref: 59 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.010720:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4af20 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b067 expref: 59 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.010746:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff907105907300) 00010000:00010000:3.0:1787893032.010750:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787893032.010799:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907104f47e00, rc 0) 00000100:00100000:3.0:1787893032.010905:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712eb55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+59:10557:x1874741431425664:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 Request processed in 617us (2859us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893032.010914:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 120 00010000:00010000:2.0:1787893032.015898:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893032.032740:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893032.032891:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431425792 00000100:00100000:2.0:1787893032.032910:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431425792 00000100:00100000:2.0:1787893032.033017:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 37 00000100:00100000:2.0:1787893032.033034:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4829748d-dde1-497a-9623-0e4326f0972c+8:2360:x1874741431425792:12345-192.168.202.29@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1787893032.033049:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787893032.034600:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4829748d-dde1-497a-9623-0e4326f0972c+9:2360:x1874741431425792:12345-192.168.202.29@tcp:2:lhsmtool_posix.0 Request processed in 1558us (1860us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787893032.034614:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 37 00000100:00100000:3.0:1787893032.038621:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893032.038800:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431426048 00000100:00100000:1.0:1787893032.038816:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431426048 00000100:00100000:1.0:1787893032.038900:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 30 00000100:00100000:1.0:1787893032.038913:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f534a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+59:10557:x1874741431426048:12345-192.168.202.29@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787893032.039305:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f534a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+60:10557:x1874741431426048:12345-192.168.202.29@tcp:35:lhsmtool_posix.0 Request processed in 393us (700us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1787893032.039314:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 30 00000100:00100000:1.0:1787893032.045189:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893032.045317:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431426304 00000100:00100000:2.0:1787893032.045332:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431426304 00000100:00100000:2.0:1787893032.045423:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 121 00000100:00100000:2.0:1787893032.045436:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712eb54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+60:10557:x1874741431426304:12345-192.168.202.29@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787893032.045608:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712eb54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+60:10557:x1874741431426304:12345-192.168.202.29@tcp:57:lhsmtool_posix.0 Request processed in 174us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893032.045617:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 121 00000100:00100000:0.0:1787893032.049229:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893032.049469:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431426432 00000100:00100000:3.0:1787893032.049486:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431426432 00000100:00100000:3.0:1787893032.049579:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 122 00000100:00100000:3.0:1787893032.049591:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+60:10557:x1874741431426432:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787893032.049619:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893032.049648:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4af27 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b06e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.049834:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4af2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.049852:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4af2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.049866:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4af2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893032.049918:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787893032.049942:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4af2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.049988:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4af27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b06e expref: 62 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.050011:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4af2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b06e expref: 61 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.050021:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff907105907300) 00010000:00010000:3.0:1787893032.050024:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787893032.050030:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907104f47800, rc 0) 00000100:00100000:3.0:1787893032.050128:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+61:10557:x1874741431426432:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 Request processed in 538us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893032.050135:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 122 00000100:00100000:3.0:1787893032.057532:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893032.057665:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431426560 00000100:00100000:1.0:1787893032.057682:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431426560 00000100:00100000:1.0:1787893032.057802:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 38 00000100:00100000:1.0:1787893032.057827:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f536300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4829748d-dde1-497a-9623-0e4326f0972c+9:2361:x1874741431426560:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787893032.057855:0:6702:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893032.057884:0:6702:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de8b53ad/0x825e3f5022b4af35 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b075 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787893032.057921:0:6702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a911527, blocks: 0x1 00010000:00010000:1.0:1787893032.057959:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=359s v=(0 0) 00010000:00010000:1.0:1787893032.057965:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893032.057979:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de8b53ad/0x825e3f5022b4af35 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b075 expref: 10 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893032.058000:0:6702:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000de8b53ad/0x825e3f5022b4af35 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b075 expref: 10 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893032.058038:0:6702:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90710153b200, rc 0) 00000100:00100000:1.0:1787893032.058116:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f536300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4829748d-dde1-497a-9623-0e4326f0972c+10:2361:x1874741431426560:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 Request processed in 302us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893032.058125:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 38 00000100:00100000:2.0:1787893032.063042:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893032.063179:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431426816 00000100:00100000:0.0:1787893032.063192:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431426816 00000100:00100000:0.0:1787893032.063277:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 123 00000100:00100000:0.0:1787893032.063291:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907108387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+61:10557:x1874741431426816:12345-192.168.202.29@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787893032.063476:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907108387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+61:10557:x1874741431426816:12345-192.168.202.29@tcp:57:lhsmtool_posix.0 Request processed in 186us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893032.063484:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 123 00000100:00100000:2.0:1787893032.068910:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893032.069073:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431426944 00000100:00100000:3.0:1787893032.069089:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431426944 00000100:00100000:3.0:1787893032.069279:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 39 00000100:00100000:3.0:1787893032.069292:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907108385f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4829748d-dde1-497a-9623-0e4326f0972c+10:10557:x1874741431426944:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787893032.069320:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893032.069435:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049b820b1/0x825e3f5022b4af3c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b07c expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.069668:0:6701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000de8b53ad/0x825e3f5022b4af35 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b075 expref: 11 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.069681:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893032.069687:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893032.069694:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049b820b1/0x825e3f5022b4af3c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b07c expref: 11 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.069743:0:6701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000de8b53ad/0x825e3f5022b4af35 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b075 expref: 11 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.069886:0:6701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000de8b53ad/0x825e3f5022b4af35 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b075 expref: 11 pid: 6702 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893032.069908:0:6701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f535f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6701:1874741455556224:192.168.202.29@tcp:104: 00000100:00100000:3.0:1787893032.070309:0:6701:0:(client.c:2715:ptlrpc_set_wait()) set ffff90713f588f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787893032.075279:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893032.075588:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431427072 00000100:00100000:0.0:1787893032.075601:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431427072 00010000:00010000:0.0:1787893032.075657:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000de8b53ad/0x825e3f5022b4af35 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b075 expref: 12 pid: 6702 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893032.075709:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 54 00000100:00100000:0.0:1787893032.075721:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712eb54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4829748d-dde1-497a-9623-0e4326f0972c+12:2360:x1874741431427072:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893032.075785:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893032.075831:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000de8b53ad/0x825e3f5022b4af35 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b075 expref: 12 pid: 6702 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893032.075849:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000de8b53ad/0x825e3f5022b4af35 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b075 expref: 12 pid: 6702 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893032.075886:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787893032.075892:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787893032.075903:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000049b820b1/0x825e3f5022b4af3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b07c expref: 12 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893032.075916:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049b820b1/0x825e3f5022b4af3c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b07c expref: 12 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893032.075974:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000049b820b1/0x825e3f5022b4af3c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b07c expref: 12 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893032.075992:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1874741455556352:192.168.202.29@tcp:105: 00000100:00100000:0.0:1787893032.076111:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff90711031ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1787893032.082012:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1874741455556352:192.168.202.29@tcp:105: 00010000:00010000:0.0:1787893032.082067:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893032.082169:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712eb54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4829748d-dde1-497a-9623-0e4326f0972c+12:2360:x1874741431427072:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 6441us (6896us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893032.082187:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 54 00010000:00010000:2.0:1787893032.087678:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de8b53ad/0x825e3f5022b4af35 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b075 expref: 11 pid: 6702 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893032.087721:0:6701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f535f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6701:1874741455556224:192.168.202.29@tcp:104: 00010000:00010000:2.0:1787893032.087803:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000049b820b1/0x825e3f5022b4af3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b07c expref: 10 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.087855:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907104f47200, rc 0) 00000100:00100000:2.0:1787893032.088079:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907108385f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4829748d-dde1-497a-9623-0e4326f0972c+10:10557:x1874741431426944:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 Request processed in 18787us (19182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893032.088090:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 39 00000100:00100000:3.0:1787893032.092893:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893032.093052:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431427200 00000100:00100000:0.0:1787893032.093068:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431427200 00002000:00100000:0.0:1787893032.093162:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff90713f535c00 x1874741431427200/t0(0) o4->4829748d-dde1-497a-9623-0e4326f0972c@192.168.202.29@tcp:193/0 lens 504/0 e 0 to 0 dl 1787893043 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787893032.093183:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90713f535c00 with x1874741431427200 ext(0->12) 00002000:00010000:0.0:1787893032.093191:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90713f535c00 00000100:00100000:0.0:1787893032.093231:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 2 00000100:00100000:0.0:1787893032.093244:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f535c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4829748d-dde1-497a-9623-0e4326f0972c+10:2361:x1874741431427200:12345-192.168.202.29@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787893032.093894:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f535c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4829748d-dde1-497a-9623-0e4326f0972c+12:2361:x1874741431427200:12345-192.168.202.29@tcp:4:lhsmtool_posix.0 Request processed in 646us (1013us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787893032.093904:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 2 00002000:00100000:0.0:1787893032.093914:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff90713f535c00 x1874741431427200/t4294967308(0) o4->4829748d-dde1-497a-9623-0e4326f0972c@192.168.202.29@tcp:193/0 lens 504/448 e 0 to 0 dl 1787893043 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787893032.093923:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90713f535c00 with x1874741431427200 ext(0->12) 00002000:00010000:0.0:1787893032.093927:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90713f535c00 00000100:00100000:3.0:1787893032.102068:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893032.102539:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431427328 00000100:00100000:1.0:1787893032.102554:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431427328 00000100:00100000:1.0:1787893032.102638:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 124 00000100:00100000:1.0:1787893032.102651:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f536680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+61:10557:x1874741431427328:12345-192.168.202.29@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787893032.194965:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967357 is committed 00000020:00080000:2.0:1787893032.194997:0:5870:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:2.0:1787893032.195015:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967401 is committed 00000004:00080000:2.0:1787893032.195036:0:5870:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:2.0:1787893032.195062:0:5870:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:2.0:1787893032.195090:0:5870:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:2.0:1787893032.195106:0:5870:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff907110297780 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1787893032.195111:0:5870:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90713f93af00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff907109145b40 00000020:00080000:2.0:1787893032.195115:0:5870:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90713f93a700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff907137e26000 00000020:00080000:2.0:1787893032.195186:0:5870:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff907139cde3c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1787893032.195190:0:5870:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90712ea65800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff907139cde9c0 00000020:00080000:2.0:1787893032.195193:0:5870:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90712ea65600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9071086d8c00 00000020:00080000:2.0:1787893032.195210:0:5881:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1787893032.195556:0:5881:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1787893032.195843:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787893032.195877:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907108384380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455556480:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787893032.195989:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893032.196083:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455556480 00000100:00100000:2.0:1787893032.196090:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455556608:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787893032.196094:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455556480 00000100:00100000:2.0:1787893032.196120:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893032.196179:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787893032.196185:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f566300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455556736:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787893032.196193:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455556608 00000100:00100000:1.0:1787893032.196196:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455556608 00000100:00100000:2.0:1787893032.196211:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893032.196217:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455556736 00000100:00100000:1.0:1787893032.196220:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455556736 00000100:00100000:1.0:1787893032.196239:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787893032.196433:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f565f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1874741455556480:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787893032.196486:0:6702:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:1.0:1787893032.196539:0:6702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a911526, atime: 0x6a911526, ctime: 0x6a911526, blocks: 0x1 00010000:00010000:1.0:1787893032.196549:0:6702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003298ec6/0x825e3f5022b4af43 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893032.196572:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=359s v=(0 0) 00010000:00010000:1.0:1787893032.196577:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893032.196585:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003298ec6/0x825e3f5022b4af43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893032.196616:0:6702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003298ec6/0x825e3f5022b4af43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893032.196629:0:6702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003298ec6/0x825e3f5022b4af43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893032.196638:0:6702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003298ec6/0x825e3f5022b4af43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893032.196661:0:6702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787893032.199693:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787893032.199740:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f564700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3305:x1874741455556608:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787893032.199805:0:6700:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:2.0:1787893032.199841:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036b645eb/0x825e3f5022b4af4a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.199872:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000063968e9f/0x825e3f5022b4ad05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afdb expref: 11 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.199883:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787893032.199888:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787893032.199893:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036b645eb/0x825e3f5022b4af4a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.199948:0:6700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000063968e9f/0x825e3f5022b4ad05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afdb expref: 11 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.199970:0:6700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000063968e9f/0x825e3f5022b4ad05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afdb expref: 11 pid: 6701 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893032.199987:0:6700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f4bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6700:1874741455556864:192.168.202.29@tcp:104: 00000100:00100000:2.0:1787893032.200118:0:6700:0:(client.c:2715:ptlrpc_set_wait()) set ffff907108643b40 going to sleep for 11 seconds 00010000:00010000:2.0:1787893032.200163:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787893032.200193:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003298ec6/0x825e3f5022b4af43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.200203:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153ac00 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:2.0:1787893032.200209:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003298ec6/0x825e3f5022b4af43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.200222:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003298ec6/0x825e3f5022b4af43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.200250:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003298ec6/0x825e3f5022b4af43 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.200259:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003298ec6/0x825e3f5022b4af43 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.200291:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893032.200293:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893032.200295:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893032.209919:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893032.209986:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431427456 00000100:00100000:3.0:1787893032.210019:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431427456 00010000:00010000:3.0:1787893032.210080:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000063968e9f/0x825e3f5022b4ad05 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afdb expref: 12 pid: 6701 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893032.210130:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 55 00000100:00100000:3.0:1787893032.210144:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f535f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4829748d-dde1-497a-9623-0e4326f0972c+12:2361:x1874741431427456:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787893032.210163:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893032.210170:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000063968e9f/0x825e3f5022b4ad05 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afdb expref: 12 pid: 6701 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.210187:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000063968e9f/0x825e3f5022b4ad05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afdb expref: 12 pid: 6701 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893032.211025:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f536680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+15:10557:x1874741431427328:12345-192.168.202.29@tcp:44:lhsmtool_posix.0 Request processed in 108370us (108969us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893032.211040:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 124 00010000:00010000:3.0:1787893032.211472:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787893032.211480:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787893032.211488:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000036b645eb/0x825e3f5022b4af4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.211505:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036b645eb/0x825e3f5022b4af4a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.211537:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893032.211568:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f535f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4829748d-dde1-497a-9623-0e4326f0972c+12:2361:x1874741431427456:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 1427us (1667us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893032.211577:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 55 00010000:00010000:3.0:1787893032.211656:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063968e9f/0x825e3f5022b4ad05 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afdb expref: 11 pid: 6701 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893032.211695:0:6700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f4bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6700:1874741455556864:192.168.202.29@tcp:104: 00010000:00010000:3.0:1787893032.211720:0:6700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000036b645eb/0x825e3f5022b4af4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.211732:0:6700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000036b645eb/0x825e3f5022b4af4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.211740:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036b645eb/0x825e3f5022b4af4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.211770:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036b645eb/0x825e3f5022b4af4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.211779:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036b645eb/0x825e3f5022b4af4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.211801:0:6700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787893032.212562:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f564700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3305:x1874741455556608:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12844us (16435us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787893032.212573:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787893032.212609:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787893032.212622:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f567b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3305:x1874741455556736:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787893032.212784:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787893032.212789:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787893031 00002000:00010000:3.0:1787893032.212801:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787893032.212803:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787893031 -> 1787893031 00002000:00010000:3.0:1787893032.212806:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787893032.212837:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f567b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3305:x1874741455556736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 219us (16624us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787893032.212844:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:3.0:1787893032.212872:0:7644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787893032.212881:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036b645eb/0x825e3f5022b4af4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.212891:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9fa00 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:3.0:1787893032.212897:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036b645eb/0x825e3f5022b4af4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.212908:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036b645eb/0x825e3f5022b4af4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.212926:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036b645eb/0x825e3f5022b4af4a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.212935:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036b645eb/0x825e3f5022b4af4a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.212956:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893032.212958:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893032.212960:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787893032.213002:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90713f566300/2, rc 0, transno 4294967310 00000100:00100000:3.0:1787893032.213009:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f566300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455556736:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1787893032.213030:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90712ebc0a80/2, rc 0, transno 4294967309 00000100:00100000:3.0:1787893032.213035:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455556608:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787893032.218802:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893032.220667:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f565f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3307:x1874741455556480:12345-0@lo:6:osp-syn-0-0.0 Request processed in 24407us (24666us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787893032.220686:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787893032.220730:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431427584 00000100:00100000:1.0:1787893032.220741:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431427584 00000004:00080000:3.0:1787893032.220785:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff907108384380/2, rc 0, transno 4294967304 00000100:00100000:3.0:1787893032.220795:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907108384380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455556480:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787893032.220808:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 43 00000100:00100000:1.0:1787893032.220817:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f537b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4829748d-dde1-497a-9623-0e4326f0972c+11:2360:x1874741431427584:12345-192.168.202.29@tcp:16:lhsmtool_posix.0 00000100:00080000:1.0:1787893032.220910:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787893032.220917:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787893032.296199:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f537b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4829748d-dde1-497a-9623-0e4326f0972c+11:2360:x1874741431427584:12345-192.168.202.29@tcp:16:lhsmtool_posix.0 Request processed in 75362us (77391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893032.296219:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 43 00000001:00080000:2.0:1787893032.296273:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:2.0:1787893032.296292:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:2.0:1787893032.296326:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000100:00100000:3.0:1787893032.299426:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893032.300112:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431427840 00000100:00100000:0.0:1787893032.300127:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431427840 00000100:00100000:0.0:1787893032.300231:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 125 00000100:00100000:0.0:1787893032.300243:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f534e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+15:10557:x1874741431427840:12345-192.168.202.29@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787893032.300326:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893032.300371:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4af2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b06e expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893032.300401:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff907105907300) 00010000:00010000:0.0:1787893032.300407:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787893032.300492:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8600/0x825e3f5022b4af51 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893032.300510:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8600/0x825e3f5022b4af51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893032.300522:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8600/0x825e3f5022b4af51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787893032.303410:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000057a84d80 reply state 000000004e0fa471 transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8600/0x825e3f5022b4af51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893032.303447:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787893032.303646:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f534e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+16:10557:x1874741431427840:12345-192.168.202.29@tcp:36:lhsmtool_posix.0 Request processed in 3399us (4233us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1787893032.303657:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 125 00010000:00010000:1.0:1787893032.314186:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8600/0x825e3f5022b4af51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893032.314212:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8600/0x825e3f5022b4af51 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893032.314222:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8600/0x825e3f5022b4af51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893032.314258:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc8600 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893032.314264:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8600/0x825e3f5022b4af51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893032.314273:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8600/0x825e3f5022b4af51 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893032.314297:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff907105907300) 00010000:00010000:1.0:1787893032.314301:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893032.314307:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8600/0x825e3f5022b4af51 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893032.314315:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8600/0x825e3f5022b4af51 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893032.315625:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893032.316356:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431427968 00000100:00100000:3.0:1787893032.316372:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431427968 00000100:00100000:3.0:1787893032.316527:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 44 00000100:00100000:3.0:1787893032.316540:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4829748d-dde1-497a-9623-0e4326f0972c+6:2361:x1874741431427968:12345-192.168.202.29@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787893032.317124:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787893032.317130:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1787893031 -> 1787893030 00002000:00010000:3.0:1787893032.317133:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787893030 00002000:00010000:3.0:1787893032.317136:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787893031 -> 1787893030 00002000:00010000:3.0:1787893032.317138:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787893032.317570:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4829748d-dde1-497a-9623-0e4326f0972c+7:2361:x1874741431427968:12345-192.168.202.29@tcp:2:lhsmtool_posix.0 Request processed in 1029us (1951us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787893032.317581:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 44 00000100:00100000:3.0:1787893032.325602:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893032.327281:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431428224 00000100:00100000:0.0:1787893032.327305:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431428224 00000100:00100000:0.0:1787893032.327420:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 126 00000100:00100000:0.0:1787893032.327433:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907003899180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+15:10557:x1874741431428224:12345-192.168.202.29@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787893032.327545:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4af58 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893032.327566:0:8281:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4af12 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b060 expref: 15 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893032.327578:0:8281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4af58 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893032.327629:0:8281:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4af12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b060 expref: 15 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893032.327645:0:8281:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4af12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b060 expref: 15 pid: 8281 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893032.327661:0:8281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8281:1874741455556992:192.168.202.29@tcp:104: 00000100:00100000:0.0:1787893032.327870:0:8281:0:(client.c:2715:ptlrpc_set_wait()) set ffff907108643b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787893032.333810:0:8281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8281:1874741455556992:192.168.202.29@tcp:104: 00010000:00010000:0.0:1787893032.333864:0:8281:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4af58 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893032.334643:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893032.334860:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431428352 00000100:00100000:1.0:1787893032.334872:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431428352 00010000:00010000:1.0:1787893032.334925:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4af12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b060 expref: 16 pid: 8281 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893032.334978:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 56 00000100:00100000:1.0:1787893032.334990:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4829748d-dde1-497a-9623-0e4326f0972c+16:2360:x1874741431428352:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893032.335008:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893032.335016:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4af12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b060 expref: 16 pid: 8281 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893032.335031:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4af12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b060 expref: 16 pid: 8281 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893032.335083:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4af12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b060 expref: 16 pid: 8281 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893032.335107:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff907105907300) 00010000:00010000:1.0:1787893032.335113:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4af58 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893032.335124:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4af58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893032.335133:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4af58 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893032.335175:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893032.335245:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4829748d-dde1-497a-9623-0e4326f0972c+15:2360:x1874741431428352:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 257us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893032.335254:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 56 00010000:00010000:2.0:1787893032.335343:0:8281:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4af58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.335352:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4af58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.335392:0:8281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4af58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.335400:0:8281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4af58 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.335408:0:8281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4af58 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.335427:0:8281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc8000 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893032.335433:0:8281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4af58 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.335441:0:8281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4af58 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.335461:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff907105907300) 00010000:00010000:2.0:1787893032.335475:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787893032.335479:0:8281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4af58 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.335485:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4af58 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893032.335534:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907003899180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+14:10557:x1874741431428224:12345-192.168.202.29@tcp:55:lhsmtool_posix.0 Request processed in 8103us (9947us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787893032.335544:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 126 00000100:00100000:2.0:1787893032.340688:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893032.341212:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431428480 00000100:00100000:0.0:1787893032.341227:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431428480 00000100:00100000:0.0:1787893032.341312:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 45 00000100:00100000:0.0:1787893032.341325:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137f7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4829748d-dde1-497a-9623-0e4326f0972c+7:2362:x1874741431428480:12345-192.168.202.29@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787893032.341387:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009d033154/0x825e3f5022b4af5f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893032.341428:0:8105:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000049b820b1/0x825e3f5022b4af3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b07c expref: 7 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893032.341439:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787893032.341444:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787893032.341459:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d033154/0x825e3f5022b4af5f lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893032.341509:0:8105:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000049b820b1/0x825e3f5022b4af3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b07c expref: 7 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893032.341526:0:8105:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049b820b1/0x825e3f5022b4af3c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b07c expref: 7 pid: 6701 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893032.341546:0:8105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8105:1874741455557120:192.168.202.29@tcp:104: 00000100:00100000:0.0:1787893032.341660:0:8105:0:(client.c:2715:ptlrpc_set_wait()) set ffff907108643b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787893032.347446:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893032.347625:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431428608 00000100:00100000:1.0:1787893032.347637:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431428608 00010000:00010000:1.0:1787893032.347692:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000049b820b1/0x825e3f5022b4af3c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b07c expref: 8 pid: 6701 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893032.347746:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 57 00000100:00100000:1.0:1787893032.347802:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4829748d-dde1-497a-9623-0e4326f0972c+8:2361:x1874741431428608:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893032.347824:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893032.347857:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000049b820b1/0x825e3f5022b4af3c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b07c expref: 8 pid: 6701 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893032.347900:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000049b820b1/0x825e3f5022b4af3c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b07c expref: 8 pid: 6701 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893032.347938:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787893032.347953:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787893032.347961:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009d033154/0x825e3f5022b4af5f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893032.347974:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d033154/0x825e3f5022b4af5f lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893032.348000:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893032.348067:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4829748d-dde1-497a-9623-0e4326f0972c+8:2361:x1874741431428608:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 268us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893032.348076:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 57 00010000:00010000:0.0:1787893032.349474:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049b820b1/0x825e3f5022b4af3c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b07c expref: 7 pid: 6701 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893032.349518:0:8105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8105:1874741455557120:192.168.202.29@tcp:104: 00010000:00010000:0.0:1787893032.349560:0:8105:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009d033154/0x825e3f5022b4af5f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893032.349574:0:8105:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009d033154/0x825e3f5022b4af5f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893032.349583:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d033154/0x825e3f5022b4af5f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893032.349640:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009d033154/0x825e3f5022b4af5f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893032.349651:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d033154/0x825e3f5022b4af5f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893032.349662:0:8105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d033154/0x825e3f5022b4af5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893032.349671:0:8105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc9a00 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:0.0:1787893032.349676:0:8105:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d033154/0x825e3f5022b4af5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893032.349714:0:8105:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d033154/0x825e3f5022b4af5f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893032.349737:0:8105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d033154/0x825e3f5022b4af5f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893032.349745:0:8105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d033154/0x825e3f5022b4af5f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893032.350729:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137f7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4829748d-dde1-497a-9623-0e4326f0972c+6:2362:x1874741431428480:12345-192.168.202.29@tcp:1:lhsmtool_posix.0 Request processed in 9395us (10046us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893032.350744:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 45 00000100:00100000:3.0:1787893032.354465:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893032.355052:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431428864 00000100:00100000:2.0:1787893032.355066:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431428864 00000100:00100000:2.0:1787893032.355139:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 127 00000100:00100000:2.0:1787893032.355158:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+14:10557:x1874741431428864:12345-192.168.202.29@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787893032.355261:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4af66 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.355281:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4af66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.355293:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4af66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.355653:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4af6d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.355667:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4af20 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b067 expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.355676:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4af6d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.355738:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4af20 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b067 expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.355803:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4af20 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b067 expref: 15 pid: 5847 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893032.355823:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137f7ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1874741455557248:192.168.202.29@tcp:104: 00000100:00100000:2.0:1787893032.356328:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff90711031b000 going to sleep for 11 seconds 00000100:00100000:3.0:1787893032.362001:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893032.362511:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137f7ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1874741455557248:192.168.202.29@tcp:104: 00010000:00010000:2.0:1787893032.362554:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4af6d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893032.362708:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431428992 00000100:00100000:1.0:1787893032.362719:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431428992 00010000:00010000:1.0:1787893032.362806:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4af20 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b067 expref: 16 pid: 5847 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893032.362860:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 58 00000100:00100000:1.0:1787893032.362871:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4829748d-dde1-497a-9623-0e4326f0972c+16:2360:x1874741431428992:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893032.362894:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893032.362903:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4af20 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b067 expref: 16 pid: 5847 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893032.362939:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4af20 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b067 expref: 16 pid: 5847 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893032.362980:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4af20 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b067 expref: 16 pid: 5847 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893032.363000:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff907105907300) 00010000:00010000:1.0:1787893032.363006:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4af6d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893032.363018:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4af6d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893032.363026:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4af6d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893032.363049:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893032.363125:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4829748d-dde1-497a-9623-0e4326f0972c+15:2360:x1874741431428992:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 255us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893032.363134:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 58 00010000:00010000:2.0:1787893032.363830:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4af6d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.363841:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4af6d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787893032.364123:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1787893032.364317:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:2.0:1787893032.364373:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1787893032.364683:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137f7ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5849:1874741455557376:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787893032.365297:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893032.365356:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff90713f588600 going to sleep for 11 seconds 00000100:00100000:0.0:1787893032.366381:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455557376 00000100:00100000:0.0:1787893032.366403:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455557376 00000100:00100000:0.0:1787893032.366511:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787893032.366526:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1874741455557376:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787893032.366728:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1874741455557376:12345-0@lo:1000:mdt00_002.0 Request processed in 206us (1432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893032.366737:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787893032.366879:0:5849:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1787893032.366888:0:5849:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:3.0:1787893032.366934:0:5849:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90712ebc0a80, transno 4294967309 00000004:00080000:3.0:1787893032.366960:0:5849:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90713f566300, transno 4294967310 00000100:00100000:3.0:1787893032.366971:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137f7ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5849:1874741455557376:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1787893032.367608:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:3.0:1787893032.367819:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d3d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5849:1874741455557504:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787893032.367898:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893032.367934:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff90711031b000 going to sleep for 11 seconds 00000100:00100000:0.0:1787893032.369255:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455557504 00000100:00100000:0.0:1787893032.369282:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455557504 00000100:00100000:0.0:1787893032.369367:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787893032.369382:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1874741455557504:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787893032.370266:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d3d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5849:1874741455557504:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1787893032.370334:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4af6d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.370347:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4af6d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.370357:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4af6d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.370363:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9fe00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893032.370370:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4af6d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.370378:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4af6d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.370400:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff907105907300) 00010000:00010000:3.0:1787893032.370403:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787893032.370409:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4af6d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893032.370505:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5849:x1874741455557504:12345-0@lo:1000:mdt00_002.0 Request processed in 1125us (2606us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787893032.370538:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1787893032.371340:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4af6d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.371403:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4aeb0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.371411:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4aeb0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.373309:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4aeb0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.373318:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153ba00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893032.373324:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4aeb0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.373334:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4aeb0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.373360:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9071063d7500) 00010000:00010000:3.0:1787893032.373363:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787893032.373375:0:5849:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e600/0x825e3f5022b4aeb7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b04b expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.373389:0:5849:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e600/0x825e3f5022b4aeb7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b04b expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.373400:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e600/0x825e3f5022b4aeb7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b04b expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.373508:0:5849:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e600/0x825e3f5022b4aeb7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b04b expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893032.373552:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d3ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1874741455557632:192.168.202.29@tcp:105: 00000100:00100000:3.0:1787893032.373686:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff90711031b000 going to sleep for 11 seconds 00000100:00100000:3.0:1787893032.377895:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893032.379849:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431429120 00000100:00100000:1.0:1787893032.379884:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431429120 00000100:00100000:1.0:1787893032.380019:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 31 00000100:00100000:1.0:1787893032.380034:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137f7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+19:10556:x1874741431429120:12345-192.168.202.29@tcp:49:lfs.0 00000100:00100000:1.0:1787893032.380268:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137f7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+19:10556:x1874741431429120:12345-192.168.202.29@tcp:49:lfs.0 Request processed in 237us (2387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893032.380278:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 31 00000100:00100000:3.0:1787893032.384940:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893032.385259:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431429376 00000100:00100000:1.0:1787893032.385274:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431429376 00000100:00100000:1.0:1787893032.385355:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 128 00000100:00100000:1.0:1787893032.385368:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137e49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+19:10556:x1874741431429376:12345-192.168.202.29@tcp:58:lfs.0 00000100:00100000:2.0:1787893032.388910:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d3ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1874741455557632:192.168.202.29@tcp:105: 00010000:00010000:2.0:1787893032.388982:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4aeb0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.389025:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4aeb0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.389076:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4af74 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.389093:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4af74 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.389107:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4af74 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.389121:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4af74 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.389128:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4af74 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.389135:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4af74 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.389141:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9f400 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893032.389146:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4af74 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.389154:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4af74 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.389167:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9071063d7500) 00010000:00010000:2.0:1787893032.389171:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893032.389175:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4af74 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.389188:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4af74 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.389202:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4af66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.389208:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4af66 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.389215:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4af66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.389220:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9e400 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893032.389224:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4af66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.389231:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4af66 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.389239:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9071063d7500) 00010000:00010000:2.0:1787893032.389241:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787893032.389244:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4af66 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.389250:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4af66 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893032.389621:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+19:10557:x1874741431428864:12345-192.168.202.29@tcp:57:lhsmtool_posix.0 Request processed in 34467us (35179us total) trans 4294967407 rc 0/0 00000100:00100000:2.0:1787893032.389634:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 127 00000020:00080000:2.0:1787893032.389648:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787893032.391389:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787893032.391409:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787893032.392282:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1787893032.392298:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787893032.394315:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893032.395174:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431429632 00000100:00100000:1.0:1787893032.395193:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431429632 00000100:00100000:1.0:1787893032.395267:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 32 00000100:00100000:1.0:1787893032.395278:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713044f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+19:10557:x1874741431429632:12345-192.168.202.29@tcp:35:lhsmtool_posix.0 00000040:00080000:0.0:1787893032.397495:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000004:00080000:1.0:1787893032.397707:0:5851:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787893032.397900:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967408 00010000:00010000:1.0:1787893032.397995:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4af7b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893032.398018:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4af7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893032.398034:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4af7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893032.398045:0:5851:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4af7b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893032.398052:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4af7b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893032.398060:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4af7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893032.398089:0:5851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787893032.398230:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787893032.398239:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4af7b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.398249:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153a000 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:2.0:1787893032.398255:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4af7b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.398265:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4af7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.398281:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff907105907e00) 00010000:00010000:2.0:1787893032.398284:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787893032.398290:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4af7b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.398296:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4af7b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.398323:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893032.398325:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893032.398328:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893032.398398:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137e49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+21:10556:x1874741431429376:12345-192.168.202.29@tcp:58:lfs.0 Request processed in 13023us (13469us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893032.398422:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 128 00000100:00100000:1.0:1787893032.398671:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713044f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+20:10557:x1874741431429632:12345-192.168.202.29@tcp:35:lhsmtool_posix.0 Request processed in 3393us (4371us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1787893032.398681:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 32 00000020:00080000:1.0:1787893032.398686:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787893032.430444:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893032.430604:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431429760 00000100:00100000:0.0:1787893032.430619:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431429760 00000100:00100000:0.0:1787893032.430712:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 129 00000100:00100000:0.0:1787893032.430725:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137e49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+20:10559:x1874741431429760:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:3.0:1787893032.432211:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893032.432253:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4af82 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b083 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.432359:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4af89 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.432378:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4af89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.432392:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4af89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.432413:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4af90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.432421:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4af90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.432428:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4af90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.436398:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4af97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.436456:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4aea2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b044 expref: 21 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.436469:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4af97 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.436534:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4aea2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b044 expref: 21 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893032.436562:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4aea2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b044 expref: 21 pid: 5849 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893032.436583:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137e4a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1874741455557760:192.168.202.29@tcp:104: 00000100:00100000:3.0:1787893032.436746:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff90711031b240 going to sleep for 11 seconds 00000100:00100000:3.0:1787893032.440566:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893032.441078:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431430016 00000100:00100000:0.0:1787893032.441093:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431430016 00000100:00100000:0.0:1787893032.441177:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 33 00000100:00100000:0.0:1787893032.441192:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137e48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+22:5601:x1874741431430016:12345-192.168.202.29@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787893032.441549:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137e48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+23:5601:x1874741431430016:12345-192.168.202.29@tcp:35:ldlm_bl.0 Request processed in 357us (998us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1787893032.441559:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 33 00000100:00100000:2.0:1787893032.441832:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137e4a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1874741455557760:192.168.202.29@tcp:104: 00010000:00010000:2.0:1787893032.441874:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4af97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893032.446135:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893032.447688:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431430144 00000100:00100000:1.0:1787893032.447711:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431430144 00010000:00010000:1.0:1787893032.448430:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4aea2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b044 expref: 23 pid: 5849 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893032.448503:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 59 00000100:00100000:1.0:1787893032.448518:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebbca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4829748d-dde1-497a-9623-0e4326f0972c+23:2361:x1874741431430144:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893032.448540:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893032.448549:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4aea2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b044 expref: 23 pid: 5849 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893032.448566:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4aea2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b044 expref: 23 pid: 5849 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893032.448596:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4aea2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b044 expref: 23 pid: 5849 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893032.448621:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9071063d7500) 00010000:00010000:1.0:1787893032.448626:0:8463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4af97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893032.448637:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4af97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893032.448666:0:8463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4af97 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893032.448706:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893032.448983:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebbca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4829748d-dde1-497a-9623-0e4326f0972c+22:2361:x1874741431430144:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 468us (2865us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893032.448992:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 59 00010000:00010000:2.0:1787893032.449167:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4af97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.449177:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4af97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893032.449251:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787893032.449257:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787893032.449283:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4af97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.449299:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4af97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.449310:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4af89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.449317:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4af89 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.449325:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4af89 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.449332:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f47e00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893032.449337:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4af89 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.449346:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4af89 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.449357:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff907105cff400) 00010000:00010000:2.0:1787893032.449360:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893032.449364:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4af89 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.449370:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4af89 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.449396:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4af90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.449403:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4af90 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.449419:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4af90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.449425:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f47200 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893032.449428:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4af90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.449435:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4af90 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.449444:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9071063d7d00) 00010000:00010000:2.0:1787893032.449455:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893032.449459:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4af90 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.449465:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4af90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.449512:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4af82 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b083 expref: 22 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.449528:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4af97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b083 expref: 21 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893032.449552:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9071063d7500) 00010000:00010000:2.0:1787893032.449555:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787893032.449558:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907104f47800, rc 0) 00000100:00100000:2.0:1787893032.449594:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137e49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+21:10559:x1874741431429760:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 18871us (19168us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893032.449602:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 129 00010000:00010000:3.0:1787893033.033860:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787893033.318828:0:12117:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787893033.318843:0:12117:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787893033.318927:0:12117:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787893033.318934:0:12117:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1787893033.418597:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787893033.418612:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787893033.418664:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787893033.418672:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787893033.419067:0:11693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbdf80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1874741455557888:192.168.202.29@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787893033.419653:0:11693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071052b5900 going to sleep for 11 seconds 00000100:00100000:1.0:1787893033.442483:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893033.443931:0:11693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbdf80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1874741455557888:192.168.202.29@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787893033.444739:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431430272 00000100:00100000:2.0:1787893033.444774:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431430272 00000100:00100000:2.0:1787893033.444874:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 130 00000100:00100000:2.0:1787893033.444888:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712eb56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+21:10571:x1874741431430272:12345-192.168.202.29@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787893033.444936:0:5849:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787893033.445084:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712eb56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+21:10571:x1874741431430272:12345-192.168.202.29@tcp:53:lhsmtool_posix.0 Request processed in 199us (2618us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893033.445093:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 130 00000100:00080000:2.0:1787893033.445121:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787893033.448296:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893033.452259:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431430528 00000100:00100000:1.0:1787893033.452284:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431430528 00000100:00100000:1.0:1787893033.452386:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 131 00000100:00100000:1.0:1787893033.452401:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137e4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+21:10571:x1874741431430528:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787893033.453009:0:8281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893033.453041:0:8281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4af9e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b08a expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893033.453186:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4afa5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893033.453206:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4afa5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893033.453224:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4afa5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893033.453238:0:8281:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787893033.456703:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4af9e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b08a expref: 24 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893033.456784:0:8281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4afa5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b08a expref: 23 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893033.456796:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9071063d7500) 00010000:00010000:1.0:1787893033.456799:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787893033.456805:0:8281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90710153bc00, rc 0) 00000100:00100000:1.0:1787893033.456930:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137e4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+23:10571:x1874741431430528:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 Request processed in 4528us (8645us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1787893033.456941:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 131 00000100:00100000:2.0:1787893033.478485:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893033.478691:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431430784 00000100:00100000:3.0:1787893033.478706:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431430784 00000100:00100000:3.0:1787893033.478793:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 132 00000100:00100000:3.0:1787893033.478807:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+23:10571:x1874741431430784:12345-192.168.202.29@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787893033.478934:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46800/0x825e3f5022b4afb3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893033.478958:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46800/0x825e3f5022b4afb3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893033.478987:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46800/0x825e3f5022b4afb3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893033.479273:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46800/0x825e3f5022b4afb3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893033.479282:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46800/0x825e3f5022b4afb3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893033.479290:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46800/0x825e3f5022b4afb3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893033.479298:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f46800 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893033.479305:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46800/0x825e3f5022b4afb3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893033.479315:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46800/0x825e3f5022b4afb3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893033.479485:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893033.479729:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431430912 00000100:00100000:2.0:1787893033.479737:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431430912 00000100:00100000:2.0:1787893033.479836:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 9 00000100:00100000:2.0:1787893033.479845:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107fa7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4829748d-dde1-497a-9623-0e4326f0972c+25:2361:x1874741431430912:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787893033.479862:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893033.483625:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4afa5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b08a expref: 25 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893033.483665:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9071063d7500) 00010000:00010000:2.0:1787893033.483699:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893033.484654:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107fa7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4829748d-dde1-497a-9623-0e4326f0972c+24:2361:x1874741431430912:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 4800us (5160us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893033.484670:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 9 00010000:00010000:3.0:1787893033.486654:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9071063d7500) 00010000:00010000:3.0:1787893033.486665:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787893033.486674:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46800/0x825e3f5022b4afb3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893033.486687:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46800/0x825e3f5022b4afb3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787893033.487484:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787893033.487491:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787893033.488060:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787893033.488073:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787893033.488243:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+23:10571:x1874741431430784:12345-192.168.202.29@tcp:57:lhsmtool_posix.0 Request processed in 9429us (9766us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1787893033.488259:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 132 00000100:00100000:0.0:1787893033.492296:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893033.492387:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431431168 00000100:00100000:3.0:1787893033.492400:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431431168 00000100:00100000:3.0:1787893033.492485:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 34 00000100:00100000:3.0:1787893033.492508:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+23:10571:x1874741431431168:12345-192.168.202.29@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787893033.492890:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+24:10571:x1874741431431168:12345-192.168.202.29@tcp:35:lhsmtool_posix.0 Request processed in 384us (609us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1787893033.492900:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 34 00000100:00100000:3.0:1787893033.523305:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893033.523359:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893033.523400:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893033.523436:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893033.523484:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431431552 00000100:00100000:3.0:1787893033.523498:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431431552 00000100:00100000:3.0:1787893033.523567:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431431424 00000100:00100000:3.0:1787893033.523573:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431431424 00000100:00100000:3.0:1787893033.523611:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 77 00000100:00100000:3.0:1787893033.523622:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071083a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4829748d-dde1-497a-9623-0e4326f0972c+6:2362:x1874741431431552:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1787893033.523714:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071083a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4829748d-dde1-497a-9623-0e4326f0972c+6:2362:x1874741431431552:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 93us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893033.523723:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 77 00000100:00100000:3.0:1787893033.523743:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 78 00000100:00100000:3.0:1787893033.523786:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907113d11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4829748d-dde1-497a-9623-0e4326f0972c+7:2362:x1874741431431424:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1787893033.523817:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907113d11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4829748d-dde1-497a-9623-0e4326f0972c+7:2362:x1874741431431424:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 68us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893033.523824:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 78 00000100:00080000:3.0:1787893033.523848:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787893033.526649:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431431296 00000100:00100000:0.0:1787893033.526674:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431431296 00000100:00100000:0.0:1787893033.526792:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 288 00000100:00100000:0.0:1787893033.526805:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+13:2362:x1874741431431296:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1787893033.526897:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+13:2362:x1874741431431296:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 94us (3609us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893033.526905:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 288 00000100:00100000:0.0:1787893033.526963:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431431680 00000100:00100000:0.0:1787893033.526968:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431431680 00000100:00100000:0.0:1787893033.527021:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 140 00000100:00100000:0.0:1787893033.527029:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907113d12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db96701a-d972-4021-b77b-4d58b82fa12c+5:2362:x1874741431431680:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1787893033.527063:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907113d12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db96701a-d972-4021-b77b-4d58b82fa12c+5:2362:x1874741431431680:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 35us (3627us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893033.527070:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 140 00000100:00080000:3.0:1787893033.527378:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787893034.058385:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893034.705450:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f4d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455558016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787893034.705567:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893034.705711:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455558016 00000100:00100000:2.0:1787893034.705722:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455558016 00000100:00100000:2.0:1787893034.706263:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787893034.706277:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1874741455558016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787893034.706326:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787893034.706396:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1874741455558016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893034.706403:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1787893034.707587:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787893034.707663:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f4d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455558016:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1787893034.775460:0:6725:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:2.0:1787893034.775495:0:6725:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00010000:00010000:3.0:1787893035.086617:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787893035.379838:0:12169:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787893035.379854:0:12169:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787893035.379911:0:12169:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787893035.379919:0:12169:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787893035.579913:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893035.580063:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431431936 00000100:00100000:2.0:1787893035.580077:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431431936 00000100:00100000:2.0:1787893035.580179:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 133 00000100:00100000:2.0:1787893035.580193:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+24:10592:x1874741431431936:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:2.0:1787893035.580227:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893035.580255:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4afba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b091 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893035.580410:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e000/0x825e3f5022b4afc1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893035.580442:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e000/0x825e3f5022b4afc1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893035.580459:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e000/0x825e3f5022b4afc1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893035.580475:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787893035.580665:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4afba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b091 expref: 27 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893035.580686:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e000/0x825e3f5022b4afc1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b091 expref: 26 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893035.580696:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9071063d7500) 00010000:00010000:2.0:1787893035.580699:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787893035.580703:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9e000, rc 0) 00000100:00100000:2.0:1787893035.580800:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+26:10592:x1874741431431936:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 612us (907us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1787893035.580807:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 133 00000100:00080000:0.0:1787893035.581114:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787893035.589193:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893035.590195:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431432064 00000100:00100000:1.0:1787893035.590214:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431432064 00000100:00100000:1.0:1787893035.590301:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 134 00000100:00100000:1.0:1787893035.590314:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+26:10592:x1874741431432064:12345-192.168.202.29@tcp:54:lfs.0 00010000:00010000:1.0:1787893035.590413:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ac00/0x825e3f5022b4afcf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893035.590450:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ac00/0x825e3f5022b4afcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893035.590465:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ac00/0x825e3f5022b4afcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893035.590502:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ac00/0x825e3f5022b4afcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893035.590510:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ac00/0x825e3f5022b4afcf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893035.590537:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ac00/0x825e3f5022b4afcf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893035.590545:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153ac00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893035.590550:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ac00/0x825e3f5022b4afcf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893035.590559:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ac00/0x825e3f5022b4afcf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893035.590575:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9071063d7500) 00010000:00010000:1.0:1787893035.590578:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787893035.590584:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ac00/0x825e3f5022b4afcf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893035.590592:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ac00/0x825e3f5022b4afcf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893035.591250:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+26:10592:x1874741431432064:12345-192.168.202.29@tcp:54:lfs.0 Request processed in 378us (1513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893035.591262:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 134 00000100:00100000:2.0:1787893035.671878:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893035.672028:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431432192 00000100:00100000:3.0:1787893035.672043:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431432192 00000100:00100000:3.0:1787893035.672181:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 46 00000100:00100000:3.0:1787893035.672195:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4829748d-dde1-497a-9623-0e4326f0972c+6:2362:x1874741431432192:12345-192.168.202.29@tcp:101:cat.0 00010000:00010000:3.0:1787893035.672220:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893035.672249:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f700353/0x825e3f5022b4afd6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b098 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787893035.672289:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a911526, atime: 0x6a911526, ctime: 0x6a911526, blocks: 0xb 00010000:00010000:3.0:1787893035.672316:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=363s v=(0 0) 00010000:00010000:3.0:1787893035.672322:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893035.672343:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f700353/0x825e3f5022b4afd6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b098 expref: 7 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893035.672367:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006f700353/0x825e3f5022b4afd6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b098 expref: 7 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893035.672384:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907104f46800, rc 0) 00000100:00100000:3.0:1787893035.672497:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4829748d-dde1-497a-9623-0e4326f0972c+7:2362:x1874741431432192:12345-192.168.202.29@tcp:101:cat.0 Request processed in 305us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893035.672505:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 46 00000100:00080000:0.0:1787893035.673443:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787893035.678014:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893035.678141:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431432320 00000100:00100000:3.0:1787893035.678156:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431432320 00002000:00100000:3.0:1787893035.678370:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff907137d11500 x1874741431432320/t0(0) o3->4829748d-dde1-497a-9623-0e4326f0972c@192.168.202.29@tcp:196/0 lens 488/0 e 0 to 0 dl 1787893046 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787893035.678408:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff907137d11500 with x1874741431432320 ext(0->4095) 00002000:00010000:3.0:1787893035.678416:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff907137d11500 00000100:00100000:3.0:1787893035.678466:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 3 00000100:00100000:3.0:1787893035.678479:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4829748d-dde1-497a-9623-0e4326f0972c+7:2362:x1874741431432320:12345-192.168.202.29@tcp:3:cat.0 00000100:00100000:3.0:1787893035.679500:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4829748d-dde1-497a-9623-0e4326f0972c+7:2362:x1874741431432320:12345-192.168.202.29@tcp:3:cat.0 Request processed in 1013us (1492us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787893035.679513:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 3 00002000:00100000:3.0:1787893035.679525:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff907137d11500 x1874741431432320/t0(0) o3->4829748d-dde1-497a-9623-0e4326f0972c@192.168.202.29@tcp:196/0 lens 488/4536 e 0 to 0 dl 1787893046 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787893035.679536:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff907137d11500 with x1874741431432320 ext(0->4095) 00002000:00010000:3.0:1787893035.679541:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff907137d11500 00000100:00100000:2.0:1787893035.721634:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22d910cf-711e-44e0-9acf-212404ada550:3308:1874741455558144:0@lo:400:kworker.0 00000100:00100000:2.0:1787893035.721744:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893035.721972:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455558144 00000100:00100000:1.0:1787893035.721984:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455558144 00000100:00100000:1.0:1787893035.722073:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1787893035.722085:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+19:3308:x1874741455558144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893035.723438:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455558528:0@lo:400:kworker.0 00000100:00100000:3.0:1787893035.723512:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893035.723583:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874741455558272:0@lo:400:kworker.0 00000100:00100000:3.0:1787893035.723616:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893035.723639:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787893035.723644:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874741455558400:0@lo:400:kworker.0 00000100:00100000:3.0:1787893035.723669:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893035.723705:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455558528 00000100:00100000:3.0:1787893035.723714:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455558528 00000100:00100000:3.0:1787893035.723791:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787893035.723801:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907113d10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455558528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893035.723875:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907113d10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455558528:12345-0@lo:400:kworker.0 Request processed in 75us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893035.723903:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787893035.724169:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455558272 00000100:00100000:3.0:1787893035.724174:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455558272 00000100:00100000:3.0:1787893035.724203:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455558400 00000100:00100000:3.0:1787893035.724206:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455558400 00000100:00100000:3.0:1787893035.724245:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787893035.724252:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907113d13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874741455558272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893035.724293:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907113d13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874741455558272:12345-0@lo:400:kworker.0 Request processed in 41us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893035.724301:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787893035.724314:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787893035.724321:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e5c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874741455558400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893035.724348:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e5c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874741455558400:12345-0@lo:400:kworker.0 Request processed in 28us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893035.724354:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:3.0:1787893035.724395:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787893035.724441:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874741455558400:0@lo:400:kworker.0 00000100:00100000:3.0:1787893035.724454:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874741455558272:0@lo:400:kworker.0 00000100:00100000:3.0:1787893035.724491:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1787893035.724498:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:3.0:1787893035.724520:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff907108384380, transno 4294967304 00000100:00100000:3.0:1787893035.724533:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455558528:0@lo:400:kworker.0 00000100:00100000:1.0:1787893035.725377:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+19:3308:x1874741455558144:12345-0@lo:400:kworker.0 Request processed in 3286us (3626us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893035.725400:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1787893035.725683:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455558784:0@lo:400:kworker.0 00000100:00100000:1.0:1787893035.725736:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893035.725814:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787893035.725825:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874741455558656:0@lo:400:kworker.0 00000100:00100000:3.0:1787893035.725858:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893035.725905:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455558656 00000100:00100000:3.0:1787893035.725927:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455558656 00000100:00100000:3.0:1787893035.725984:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787893035.725994:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e5c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874741455558656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893035.726062:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e5c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874741455558656:12345-0@lo:400:kworker.0 Request processed in 69us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893035.726069:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:3.0:1787893035.726093:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787893035.726127:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874741455558656:0@lo:400:kworker.0 00000100:00100000:3.0:1787893035.726151:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455558784 00000100:00100000:3.0:1787893035.726154:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455558784 00000100:00100000:3.0:1787893035.726191:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787893035.726198:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712eb57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1874741455558784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893035.726591:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22d910cf-711e-44e0-9acf-212404ada550:3308:1874741455558144:0@lo:400:kworker.0 00000100:00080000:2.0:1787893035.726620:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787893035.726710:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712eb57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1874741455558784:12345-0@lo:400:kworker.0 Request processed in 512us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893035.726718:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787893035.726848:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455558784:0@lo:400:kworker.0 00010000:00010000:3.0:1787893036.107962:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893036.235024:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787893036.235069:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907105afb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455558912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787893036.235272:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893036.247524:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455558912 00000100:00100000:2.0:1787893036.247550:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455558912 00000100:00100000:2.0:1787893036.247946:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787893036.247971:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712eb54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874741455558912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787893036.248028:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787893036.248179:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712eb54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874741455558912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 220us (12906us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893036.248188:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787893036.248315:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907105afb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455558912:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787893037.131651:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787893037.370681:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:0.0:1787893037.370708:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:2.0:1787893037.382067:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967410 is committed 00000001:00080000:2.0:1787893037.382094:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000001:00080000:2.0:1787893037.382112:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1787893037.382133:0:5870:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1787893037.382185:0:5870:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff907102a0c9c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1787893037.382191:0:5881:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000020:00080000:2.0:1787893037.382193:0:5870:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90713f89ee00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff907137d1a0c0 00000020:00080000:2.0:1787893037.382205:0:5870:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90713f89e700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff907137e52800 00000020:00080000:0.0:1787893037.382229:0:5881:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1787893037.382512:0:5881:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000040:00080000:2.0:1787893037.577929:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787893037.577939:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787893037.577977:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787893037.577983:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787893038.156403:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893038.648133:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893038.648183:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893038.648218:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893038.648240:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893038.648265:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893038.648299:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431432832 00000100:00100000:2.0:1787893038.648320:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431432832 00000100:00100000:2.0:1787893038.648569:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431432704 00000100:00100000:2.0:1787893038.648573:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431432704 00000100:00100000:2.0:1787893038.648622:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 81 00000100:00100000:2.0:1787893038.648633:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4829748d-dde1-497a-9623-0e4326f0972c+6:2363:x1874741431432832:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1787893038.648709:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4829748d-dde1-497a-9623-0e4326f0972c+6:2363:x1874741431432832:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 79us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893038.648717:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 81 00000100:00100000:2.0:1787893038.648733:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 82 00000100:00100000:2.0:1787893038.648739:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4829748d-dde1-497a-9623-0e4326f0972c+5:2363:x1874741431432704:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1787893038.648788:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4829748d-dde1-497a-9623-0e4326f0972c+5:2363:x1874741431432704:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 48us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893038.648794:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 82 00000100:00100000:2.0:1787893038.650226:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431432448 00000100:00100000:2.0:1787893038.650240:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431432448 00000100:00100000:2.0:1787893038.650296:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 290 00000100:00100000:2.0:1787893038.650305:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+13:2363:x1874741431432448:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1787893038.650504:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431432576 00000100:00100000:1.0:1787893038.650509:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431432576 00000100:00100000:1.0:1787893038.650549:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431432960 00000100:00100000:1.0:1787893038.650552:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431432960 00000100:00100000:1.0:1787893038.650575:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 144 00000100:00100000:1.0:1787893038.650581:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+13:2363:x1874741431432576:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1787893038.650640:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+13:2363:x1874741431432448:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 336us (2420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893038.650648:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 290 00000100:00100000:2.0:1787893038.650692:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 145 00000100:00100000:2.0:1787893038.650699:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db96701a-d972-4021-b77b-4d58b82fa12c+5:2363:x1874741431432960:12345-192.168.202.29@tcp:400:kworker.0 00000100:00080000:0.0:1787893038.651641:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787893038.651649:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787893038.651652:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787893038.656897:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+13:2363:x1874741431432576:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 6291us (8750us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893038.656915:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 144 00000100:00100000:2.0:1787893038.670183:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db96701a-d972-4021-b77b-4d58b82fa12c+5:2363:x1874741431432960:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 19469us (21902us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893038.670199:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 145 00010000:00010000:3.0:1787893039.187281:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893039.817168:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787893039.817192:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455559040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787893039.817277:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893039.818626:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455559040 00000100:00100000:3.0:1787893039.818639:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455559040 00000100:00100000:3.0:1787893039.818701:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787893039.818710:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105afb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455559040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787893039.818778:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787893039.818837:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105afb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455559040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (1561us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893039.818845:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787893039.818909:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455559040:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787893039.820400:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787893040.206465:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893040.841397:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712eb54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874741455559424:0@lo:400:kworker.0 00000100:00100000:1.0:1787893040.841486:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893040.841559:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787893040.841566:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712eb54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874741455559296:0@lo:400:kworker.0 00000100:00100000:1.0:1787893040.841591:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893040.841606:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712eb57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455559808:0@lo:400:kworker.0 00000100:00100000:1.0:1787893040.841627:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893040.841664:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455559424 00000100:00100000:1.0:1787893040.841672:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455559424 00000100:00100000:1.0:1787893040.841718:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455559296 00000100:00100000:1.0:1787893040.841735:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455559296 00000100:00100000:1.0:1787893040.841793:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787893040.841804:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874741455559424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893040.841857:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874741455559424:12345-0@lo:400:kworker.0 Request processed in 55us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893040.841864:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787893040.841895:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787893040.841902:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907108384380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874741455559296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893040.841928:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907108384380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874741455559296:12345-0@lo:400:kworker.0 Request processed in 27us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893040.841933:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787893040.841966:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455559808 00000100:00100000:1.0:1787893040.841969:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455559808 00000100:00100000:1.0:1787893040.842000:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787893040.842006:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907108386d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455559808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893040.842036:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907108386d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455559808:12345-0@lo:400:kworker.0 Request processed in 30us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893040.842041:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1787893040.842056:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787893040.842061:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787893040.842097:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712eb54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874741455559296:0@lo:400:kworker.0 00000100:00100000:1.0:1787893040.842106:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1787893040.842111:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1787893040.842134:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712eb57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455559808:0@lo:400:kworker.0 00000100:00100000:1.0:1787893040.842144:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712eb54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874741455559424:0@lo:400:kworker.0 00000100:00100000:3.0:1787893040.842220:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712eb57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22d910cf-711e-44e0-9acf-212404ada550:3308:1874741455559168:0@lo:400:kworker.0 00000100:00100000:3.0:1787893040.842253:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893040.842284:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712eb55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874741455559680:0@lo:400:kworker.0 00000100:00100000:3.0:1787893040.842309:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893040.842329:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787893040.842335:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712eb55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455559552:0@lo:400:kworker.0 00000100:00100000:3.0:1787893040.842356:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893040.842396:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455559680 00000100:00100000:3.0:1787893040.842401:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455559680 00000100:00100000:3.0:1787893040.842433:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787893040.842439:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107e80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874741455559680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893040.842475:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107e80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874741455559680:12345-0@lo:400:kworker.0 Request processed in 36us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893040.842481:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787893040.842498:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455559552 00000100:00100000:3.0:1787893040.842501:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455559552 00000100:00100000:3.0:1787893040.842520:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787893040.842526:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107e81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455559552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893040.842560:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107e81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455559552:12345-0@lo:400:kworker.0 Request processed in 35us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893040.842577:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1787893040.842592:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787893040.842609:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712eb55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455559552:0@lo:400:kworker.0 00000100:00100000:3.0:1787893040.842618:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712eb55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874741455559680:0@lo:400:kworker.0 00000100:00100000:1.0:1787893040.848486:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455559168 00000100:00100000:1.0:1787893040.848510:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455559168 00000100:00100000:1.0:1787893040.848566:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1787893040.848576:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+19:3308:x1874741455559168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893040.848672:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+19:3308:x1874741455559168:12345-0@lo:400:kworker.0 Request processed in 97us (6417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893040.848679:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1787893040.849502:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712eb57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22d910cf-711e-44e0-9acf-212404ada550:3308:1874741455559168:0@lo:400:kworker.0 00010000:00010000:0.0:1787893041.232039:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893041.356096:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893041.356215:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431433088 00000100:00100000:0.0:1787893041.356226:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431433088 00000100:00100000:0.0:1787893041.356306:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 135 00000100:00100000:0.0:1787893041.356321:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907108385c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+13:10236:x1874741431433088:12345-192.168.202.29@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787893041.356441:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907108385c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+13:10236:x1874741431433088:12345-192.168.202.29@tcp:60:lhsmtool_posix.0 Request processed in 124us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893041.356449:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 135 00000100:00080000:1.0:1787893041.356676:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787893041.356938:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455559936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787893041.356987:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893041.357131:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455559936 00000100:00100000:1.0:1787893041.357136:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455559936 00000100:00100000:1.0:1787893041.357176:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787893041.357184:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455559936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787893041.357214:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787893041.357261:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455559936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893041.357267:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787893041.357714:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455559936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787893041.359593:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893041.359810:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431433344 00000100:00100000:3.0:1787893041.359983:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431433344 00000100:00100000:3.0:1787893041.360168:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 35 00000100:00100000:3.0:1787893041.360180:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+13:10236:x1874741431433344:12345-192.168.202.29@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787893041.362207:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+14:10236:x1874741431433344:12345-192.168.202.29@tcp:35:lhsmtool_posix.0 Request processed in 2018us (2616us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1787893041.362220:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 35 00000100:00100000:0.0:1787893041.766016:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893041.766116:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431433472 00000100:00100000:3.0:1787893041.766130:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431433472 00000100:00100000:3.0:1787893041.766229:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 136 00000100:00100000:3.0:1787893041.766241:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db96701a-d972-4021-b77b-4d58b82fa12c+5:11044:x1874741431433472:12345-192.168.202.29@tcp:101:lsof.0 00010000:00010000:3.0:1787893041.766268:0:8281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1787893041.766291:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787893041.766295:0:8281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4afdd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b09f expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893041.766402:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4afe4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893041.766418:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4afe4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893041.766456:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4afe4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893041.766833:0:8281:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787893041.766837:0:8281:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787893041.766956:0:8281:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4afe4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893041.766988:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4afdd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b09f expref: 7 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893041.767006:0:8281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4afe4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b09f expref: 6 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893041.767016:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907105907600) 00010000:00010000:3.0:1787893041.767018:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787893041.767022:0:8281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907104f46000, rc 0) 00000100:00100000:3.0:1787893041.767104:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db96701a-d972-4021-b77b-4d58b82fa12c+6:11044:x1874741431433472:12345-192.168.202.29@tcp:101:lsof.0 Request processed in 864us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893041.767113:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 136 00010000:00010000:3.0:1787893042.249084:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1787893042.469466:0:5870:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:1.0:1787893042.469503:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:2.0:1787893042.469661:0:5881:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1787893042.469673:0:5881:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1787893043.273528:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893043.765923:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893043.765965:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893043.765996:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893043.766016:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893043.766043:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893043.766068:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431433984 00000100:00100000:0.0:1787893043.766089:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431433984 00000100:00100000:0.0:1787893043.766139:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431433856 00000100:00100000:0.0:1787893043.766142:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431433856 00000100:00100000:0.0:1787893043.766161:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 85 00000100:00100000:0.0:1787893043.766170:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4829748d-dde1-497a-9623-0e4326f0972c+6:2361:x1874741431433984:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1787893043.766247:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4829748d-dde1-497a-9623-0e4326f0972c+6:2361:x1874741431433984:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 78us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893043.766254:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 85 00000100:00100000:0.0:1787893043.766269:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 86 00000100:00100000:0.0:1787893043.766276:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4829748d-dde1-497a-9623-0e4326f0972c+5:2361:x1874741431433856:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1787893043.766305:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4829748d-dde1-497a-9623-0e4326f0972c+5:2361:x1874741431433856:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 21us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893043.766311:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 86 00000100:00100000:0.0:1787893043.766327:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431433728 00000100:00100000:0.0:1787893043.766330:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431433728 00000100:00100000:0.0:1787893043.766360:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431434112 00000100:00100000:0.0:1787893043.766363:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431434112 00000100:00100000:0.0:1787893043.766383:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 149 00000100:00100000:0.0:1787893043.766391:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+13:2361:x1874741431433728:12345-192.168.202.29@tcp:400:kworker.0 00000100:00080000:2.0:1787893043.766417:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787893043.766422:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+13:2361:x1874741431433728:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 31us (508us total) trans 0 rc 0/0 00000100:00080000:2.0:1787893043.766424:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787893043.766428:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787893043.766432:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 149 00000100:00100000:0.0:1787893043.766445:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 150 00000100:00100000:0.0:1787893043.766451:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907108388700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db96701a-d972-4021-b77b-4d58b82fa12c+6:2361:x1874741431434112:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1787893043.766472:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907108388700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db96701a-d972-4021-b77b-4d58b82fa12c+6:2361:x1874741431434112:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 22us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893043.766484:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 150 00000100:00100000:3.0:1787893043.767342:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431433600 00000100:00100000:3.0:1787893043.767355:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431433600 00000100:00100000:3.0:1787893043.767392:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 292 00000100:00100000:3.0:1787893043.767399:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+13:2361:x1874741431433600:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1787893043.767444:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+13:2361:x1874741431433600:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 40us (1441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893043.767461:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 292 00010000:00010000:0.0:1787893044.297447:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893044.937663:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455560064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787893044.937806:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893044.937891:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455560064 00000100:00100000:1.0:1787893044.937904:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455560064 00000100:00080000:2.0:1787893044.937952:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787893044.937979:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787893044.937990:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107e81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455560064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787893044.938041:0:6704:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787893044.944115:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107e81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455560064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6106us (6289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893044.944134:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787893044.946415:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455560064:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787893045.321108:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893045.961469:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907108389880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22d910cf-711e-44e0-9acf-212404ada550:3308:1874741455560192:0@lo:400:kworker.0 00000100:00100000:2.0:1787893045.961570:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893045.961781:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907108389c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455560576:0@lo:400:kworker.0 00000100:00100000:1.0:1787893045.961831:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893045.961891:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455560576 00000100:00100000:1.0:1787893045.961901:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455560576 00000100:00100000:1.0:1787893045.961957:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787893045.961965:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712eb57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455560576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893045.962022:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712eb57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455560576:12345-0@lo:400:kworker.0 Request processed in 57us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893045.962029:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787893045.962073:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907108389c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455560576:0@lo:400:kworker.0 00000100:00100000:3.0:1787893045.962202:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455560192 00000100:00100000:3.0:1787893045.962207:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455560192 00000100:00100000:3.0:1787893045.962275:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1787893045.962282:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+19:3308:x1874741455560192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893045.962467:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907108389500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874741455560448:0@lo:400:kworker.0 00000100:00100000:0.0:1787893045.962505:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893045.962529:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787893045.962534:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90710838aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874741455560320:0@lo:400:kworker.0 00000100:00100000:0.0:1787893045.962553:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893045.962568:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f90c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455560832:0@lo:400:kworker.0 00000100:00100000:0.0:1787893045.962588:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893045.962614:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455560448 00000100:00100000:0.0:1787893045.962618:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455560448 00000100:00100000:0.0:1787893045.962656:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455560320 00000100:00100000:0.0:1787893045.962660:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455560320 00000100:00100000:0.0:1787893045.962679:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787893045.962685:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f90d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874741455560448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893045.962722:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f90d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874741455560448:12345-0@lo:400:kworker.0 Request processed in 37us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893045.962728:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787893045.962741:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787893045.962746:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f90d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874741455560320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893045.962788:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f90d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874741455560320:12345-0@lo:400:kworker.0 Request processed in 42us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893045.962794:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787893045.962825:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90710838aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874741455560320:0@lo:400:kworker.0 00000100:00100000:0.0:1787893045.962834:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907108389500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874741455560448:0@lo:400:kworker.0 00000100:00100000:0.0:1787893045.965100:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787893045.965138:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907108389c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874741455560704:0@lo:400:kworker.0 00000100:00100000:0.0:1787893045.965243:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893045.965301:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455560704 00000100:00100000:0.0:1787893045.965310:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455560704 00000100:00100000:3.0:1787893045.965976:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+19:3308:x1874741455560192:12345-0@lo:400:kworker.0 Request processed in 3688us (4400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893045.965990:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1787893045.966101:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455560832 00000100:00100000:3.0:1787893045.966108:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455560832 00000100:00100000:3.0:1787893045.966218:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787893045.966231:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f90c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455560832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893045.966408:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f90c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455560832:12345-0@lo:400:kworker.0 Request processed in 180us (3818us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893045.966415:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787893045.966507:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907108389880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22d910cf-711e-44e0-9acf-212404ada550:3308:1874741455560192:0@lo:400:kworker.0 00000100:00080000:2.0:1787893045.966542:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787893045.966548:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787893045.966851:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787893045.967060:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f90c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455560832:0@lo:400:kworker.0 00000100:00100000:0.0:1787893045.968488:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907108389500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874741455560704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893045.968602:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907108389500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874741455560704:12345-0@lo:400:kworker.0 Request processed in 1743us (3359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893045.968613:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787893045.968708:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907108389c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874741455560704:0@lo:400:kworker.0 00010000:00010000:0.0:1787893046.345568:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893046.473726:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787893046.473748:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90710838aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455560960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787893046.473844:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893046.473921:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455560960 00000100:00100000:0.0:1787893046.473931:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455560960 00000100:00100000:0.0:1787893046.473987:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787893046.473997:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907108389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455560960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787893046.474042:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787893046.474093:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907108389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455560960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893046.474102:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787893046.474680:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90710838aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455560960:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1787893046.518464:0:12375:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 00:57:24 (1787893044) 00010000:00010000:0.0:1787893047.369044:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787893047.823632:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787893047.823643:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787893047.824183:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1787893047.824190:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787893048.393856:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893048.447802:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893048.447941:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431434368 00000100:00100000:1.0:1787893048.447952:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431434368 00000100:00100000:1.0:1787893048.448032:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 137 00000100:00100000:1.0:1787893048.448043:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90710838aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+13:11310:x1874741431434368:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787893048.448073:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893048.448127:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4afeb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b0a6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893048.448209:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4aff2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893048.448223:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4aff2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893048.448234:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4aff2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893048.448262:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4aff9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893048.448283:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4aff9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893048.448289:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4aff9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893048.449077:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4b000 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893048.449089:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4b000 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893048.449096:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4b000 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893048.449106:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00000100:00080000:2.0:1787893048.449328:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787893048.450975:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4aff2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893048.450990:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4aff2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893048.450998:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4aff2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893048.451004:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153a000 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893048.451009:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4aff2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893048.451017:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4aff2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893048.451053:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff907105cffb00) 00010000:00010000:1.0:1787893048.451056:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893048.451126:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4aff2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893048.451135:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4aff2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893048.451149:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4aff9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893048.451263:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4aff9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893048.451270:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4aff9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893048.451276:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153a200 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893048.451279:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4aff9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893048.451285:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4aff9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893048.451295:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff907105907d00) 00010000:00010000:1.0:1787893048.451297:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893048.451312:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4aff9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893048.451317:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4aff9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893048.452853:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4afeb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0a6 expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893048.452876:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4b000 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0a6 expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893048.452954:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9071061f7700) 00010000:00010000:1.0:1787893048.452957:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893048.452961:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90710153bc00, rc 0) 00000100:00100000:1.0:1787893048.454592:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90710838aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+15:11310:x1874741431434368:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 Request processed in 6543us (6845us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1787893048.454604:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 137 00000100:00100000:2.0:1787893048.501491:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893048.501572:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893048.502502:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431434624 00000100:00100000:1.0:1787893048.502514:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431434624 00000100:00100000:1.0:1787893048.502584:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 138 00000100:00100000:1.0:1787893048.502624:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+15:11310:x1874741431434624:12345-192.168.202.29@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787893048.502848:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+15:11310:x1874741431434624:12345-192.168.202.29@tcp:59:lhsmtool_posix.0 Request processed in 253us (1275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893048.502856:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 138 00000100:00100000:3.0:1787893048.503440:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431434496 00000100:00100000:3.0:1787893048.503470:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431434496 00000100:00100000:3.0:1787893048.503597:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 10 00000100:00100000:3.0:1787893048.503605:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4829748d-dde1-497a-9623-0e4326f0972c+15:2361:x1874741431434496:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787893048.503619:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893048.503663:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4b000 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0a6 expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893048.503717:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9071061f7700) 00010000:00010000:3.0:1787893048.503722:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893048.503831:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4829748d-dde1-497a-9623-0e4326f0972c+14:2361:x1874741431434496:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 227us (2350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893048.503838:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 10 00000040:00080000:2.0:1787893048.843931:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787893048.843940:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787893048.844639:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787893048.844649:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787893048.893637:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893048.893675:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893048.893699:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893048.893774:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893048.893803:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893048.893836:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431434752 00000100:00100000:2.0:1787893048.893861:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431434752 00000100:00100000:0.0:1787893048.893907:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431435264 00000100:00100000:0.0:1787893048.893916:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431435264 00000100:00100000:2.0:1787893048.893917:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 294 00000100:00100000:2.0:1787893048.893925:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+13:2363:x1874741431434752:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1787893048.893954:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431434880 00000100:00100000:0.0:1787893048.893957:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431434880 00000100:00100000:0.0:1787893048.893975:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 154 00000100:00100000:0.0:1787893048.893981:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db96701a-d972-4021-b77b-4d58b82fa12c+6:2363:x1874741431435264:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1787893048.893992:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+13:2363:x1874741431434752:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 67us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893048.893999:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 294 00000100:00100000:0.0:1787893048.894007:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db96701a-d972-4021-b77b-4d58b82fa12c+6:2363:x1874741431435264:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 28us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893048.894013:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 154 00000100:00100000:0.0:1787893048.894025:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 155 00000100:00100000:0.0:1787893048.894031:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f472a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+14:2363:x1874741431434880:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1787893048.894032:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431435008 00000100:00100000:2.0:1787893048.894035:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431435008 00000100:00100000:0.0:1787893048.894053:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f472a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+14:2363:x1874741431434880:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 22us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893048.894058:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 155 00000100:00100000:2.0:1787893048.894060:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431435136 00000100:00100000:2.0:1787893048.894062:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431435136 00000100:00100000:2.0:1787893048.894083:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 89 00000100:00100000:2.0:1787893048.894090:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4829748d-dde1-497a-9623-0e4326f0972c+5:2363:x1874741431435008:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1787893048.894116:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4829748d-dde1-497a-9623-0e4326f0972c+5:2363:x1874741431435008:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 27us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893048.894122:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 89 00000100:00100000:2.0:1787893048.894133:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 90 00000100:00100000:2.0:1787893048.894139:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f471180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4829748d-dde1-497a-9623-0e4326f0972c+6:2363:x1874741431435136:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1787893048.894165:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f471180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4829748d-dde1-497a-9623-0e4326f0972c+6:2363:x1874741431435136:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 27us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893048.894171:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 90 00000100:00080000:2.0:1787893048.894191:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787893048.894196:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787893048.894198:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787893049.416956:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893050.062414:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907108389880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455561088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787893050.062506:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893050.062663:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455561088 00000100:00100000:0.0:1787893050.062673:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455561088 00000100:00100000:0.0:1787893050.062749:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1787893050.062890:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787893050.063368:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137ac5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455561088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787893050.063407:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787893050.063466:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137ac5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455561088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893050.063474:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787893050.063722:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907108389880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455561088:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787893050.442272:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893050.846741:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893050.846801:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431435392 00000100:00100000:1.0:1787893050.846810:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431435392 00000100:00100000:1.0:1787893050.846872:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 139 00000100:00100000:1.0:1787893050.846883:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712eb55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+14:11353:x1874741431435392:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:1.0:1787893050.846903:0:8281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893050.846951:0:8281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4b00e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b0ad expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893050.847016:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4b015 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893050.847030:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4b015 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893050.847041:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4b015 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893050.847056:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4b01c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893050.847063:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4b01c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893050.847069:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4b01c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893050.849136:0:8281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4b015 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893050.849152:0:8281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4b015 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893050.849160:0:8281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4b015 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893050.849167:0:8281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153a200 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893050.849172:0:8281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4b015 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893050.849190:0:8281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4b015 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893050.849207:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907105907600) 00010000:00010000:1.0:1787893050.849210:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893050.849215:0:8281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4b015 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893050.849221:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4b015 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893050.849233:0:8281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4b01c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893050.849239:0:8281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4b01c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893050.849245:0:8281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4b01c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893050.849251:0:8281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153ba00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893050.849253:0:8281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4b01c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893050.849259:0:8281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4b01c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893050.849266:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff907105907d00) 00010000:00010000:1.0:1787893050.849268:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893050.849271:0:8281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4b01c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893050.849296:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4b01c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893050.849343:0:8281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4b00e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0ad expref: 15 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893050.849355:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907105907600) 00010000:00010000:1.0:1787893050.849357:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893050.849361:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4b00e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0ad expref: 15 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893050.849371:0:8281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90710153a000, rc 0) 00000100:00100000:1.0:1787893050.849455:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712eb55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+14:11353:x1874741431435392:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 2572us (2722us total) trans 0 rc 301/301 00000100:00100000:1.0:1787893050.849463:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 139 00000100:00080000:1.0:1787893050.849504:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787893050.857526:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893050.861234:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431435648 00000100:00100000:1.0:1787893050.861248:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431435648 00000100:00100000:1.0:1787893050.861343:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 140 00000100:00100000:1.0:1787893050.861356:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107e83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+14:11353:x1874741431435648:12345-192.168.202.29@tcp:36:lfs.0 00010000:00010000:1.0:1787893050.861417:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893050.861446:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fbe00/0x825e3f5022b4a98c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aee6 expref: 14 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893050.861471:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907105907600) 00010000:00010000:1.0:1787893050.861477:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787893050.861809:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4b023 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893050.862357:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4afe4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b09f expref: 5 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893050.862367:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4b023 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893050.862413:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4afe4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b09f expref: 5 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893050.862433:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4afe4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b09f expref: 5 pid: 8281 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893050.862452:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712eb55180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1874741455561216:192.168.202.29@tcp:104: 00000100:00100000:1.0:1787893050.862568:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff90713f4da240 going to sleep for 11 seconds 00000100:00100000:1.0:1787893050.864929:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893050.865338:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712eb55180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1874741455561216:192.168.202.29@tcp:104: 00010000:00010000:3.0:1787893050.865365:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4b023 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893050.865479:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431435776 00000100:00100000:2.0:1787893050.865486:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431435776 00010000:00010000:2.0:1787893050.865538:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4afe4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b09f expref: 6 pid: 8281 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893050.865581:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 60 00000100:00100000:2.0:1787893050.865590:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712eb54e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db96701a-d972-4021-b77b-4d58b82fa12c+6:2361:x1874741431435776:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787893050.865605:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893050.865611:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4afe4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b09f expref: 6 pid: 8281 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893050.865622:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4afe4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b09f expref: 6 pid: 8281 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893050.865643:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4afe4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b09f expref: 6 pid: 8281 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893050.865657:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907105907600) 00010000:00010000:2.0:1787893050.865662:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4b023 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893050.865670:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4b023 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893050.865677:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4b023 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893050.865696:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893050.865738:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712eb54e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db96701a-d972-4021-b77b-4d58b82fa12c+5:2361:x1874741431435776:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 149us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893050.865746:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 60 00010000:00010000:2.0:1787893050.865870:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4b023 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893050.865884:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4b023 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893050.865908:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fa00/0x825e3f5022b4b02a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893050.865917:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fa00/0x825e3f5022b4b02a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893050.865923:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fa00/0x825e3f5022b4b02a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893050.867071:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787893050.867087:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4b023 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893050.867097:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4b023 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893050.867104:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4b023 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893050.867110:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153bc00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893050.867115:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4b023 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893050.867123:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4b023 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893050.867138:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907105907600) 00010000:00010000:2.0:1787893050.867141:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893050.867155:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4b023 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893050.867161:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4b023 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787893050.867178:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000602f1912 reply state 000000008b2b432f transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fa00/0x825e3f5022b4b02a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893050.867188:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787893050.867277:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107e83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+15:11353:x1874741431435648:12345-192.168.202.29@tcp:36:lfs.0 Request processed in 5922us (9762us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1787893050.867296:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 140 00000100:00080000:3.0:1787893050.868685:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787893050.871037:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fa00/0x825e3f5022b4b02a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893050.871057:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fa00/0x825e3f5022b4b02a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893050.871065:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fa00/0x825e3f5022b4b02a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893050.871071:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9fa00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:0.0:1787893050.871076:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fa00/0x825e3f5022b4b02a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893050.871082:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fa00/0x825e3f5022b4b02a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893050.871099:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff907105cffd00) 00010000:00010000:0.0:1787893050.871102:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893050.871106:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fa00/0x825e3f5022b4b02a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893050.871111:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fa00/0x825e3f5022b4b02a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893050.929304:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893050.930335:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431435904 00000100:00100000:1.0:1787893050.930348:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431435904 00000100:00100000:2.0:1787893050.930544:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 141 00000100:00100000:2.0:1787893050.930556:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f471880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+14:11361:x1874741431435904:12345-192.168.202.29@tcp:101:lctl.0 00010000:00010000:2.0:1787893050.930586:0:8281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893050.930615:0:8281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fa00/0x825e3f5022b4b031 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b0b4 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893050.930691:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f000/0x825e3f5022b4b038 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893050.930707:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f000/0x825e3f5022b4b038 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893050.930720:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f000/0x825e3f5022b4b038 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893050.930831:0:8281:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787893050.930835:0:8281:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787893050.930882:0:8281:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f000/0x825e3f5022b4b038 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893050.930909:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fa00/0x825e3f5022b4b031 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0b4 expref: 16 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893050.930927:0:8281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f000/0x825e3f5022b4b038 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0b4 expref: 15 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893050.930936:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907105cff800) 00010000:00010000:2.0:1787893050.930939:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787893050.930943:0:8281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9f000, rc 0) 00000100:00100000:2.0:1787893050.931016:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f471880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+15:11361:x1874741431435904:12345-192.168.202.29@tcp:101:lctl.0 Request processed in 462us (1739us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893050.931024:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 141 00000100:00100000:3.0:1787893051.008214:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893051.008373:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431436032 00000100:00100000:1.0:1787893051.008384:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431436032 00000100:00100000:1.0:1787893051.008501:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 142 00000100:00100000:1.0:1787893051.008513:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107e82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+15:11367:x1874741431436032:12345-192.168.202.29@tcp:101:bash.0 00010000:00010000:1.0:1787893051.008536:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893051.008561:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4b03f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b0bb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.008631:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4b046 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.008658:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4b046 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.008670:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4b046 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.008686:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4b04d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.008693:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4b04d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.008701:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4b04d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893051.009433:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4b054 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893051.009444:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4b054 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893051.009452:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4b054 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893051.009496:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1787893051.009499:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787893051.009529:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4b054 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893051.009539:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4b046 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893051.009544:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4b046 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893051.009548:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4b046 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893051.009552:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153ba00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893051.009555:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4b046 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893051.009560:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4b046 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893051.009570:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907105cff800) 00010000:00010000:3.0:1787893051.009572:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893051.009575:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4b046 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893051.009579:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4b046 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893051.009588:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4b04d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893051.009592:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4b04d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893051.009595:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4b04d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893051.009603:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153a200 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893051.009605:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4b04d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893051.009608:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4b04d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893051.009612:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff907105907d00) 00010000:00010000:3.0:1787893051.009614:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893051.009615:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4b04d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893051.009618:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4b04d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893051.009647:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4b03f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0bb expref: 17 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893051.009658:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4b054 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0bb expref: 16 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893051.009663:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9071063d7000) 00010000:00010000:3.0:1787893051.009664:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787893051.009666:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907104f46200, rc 0) 00000100:00100000:3.0:1787893051.009732:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107e82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+16:11367:x1874741431436032:12345-192.168.202.29@tcp:101:bash.0 Request processed in 1221us (1530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893051.009739:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 142 00000100:00100000:0.0:1787893051.013195:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893051.013391:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431436288 00000100:00100000:1.0:1787893051.013404:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431436288 00000100:00100000:1.0:1787893051.013478:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 143 00000100:00100000:1.0:1787893051.013489:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907108389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+16:11367:x1874741431436288:12345-192.168.202.29@tcp:101:bash.0 00010000:00010000:1.0:1787893051.013512:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893051.013540:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4b05b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b0c2 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.013717:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b200/0x825e3f5022b4b062 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.013731:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b200/0x825e3f5022b4b062 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.013744:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b200/0x825e3f5022b4b062 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.014175:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b069 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.014183:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b069 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.014191:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b069 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787893051.015179:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1787893051.015556:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4b070 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.015569:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4b070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.015581:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4b070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.015621:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b200/0x825e3f5022b4b062 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.015629:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b200/0x825e3f5022b4b062 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.015636:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b200/0x825e3f5022b4b062 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.015643:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153b200 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893051.015647:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b200/0x825e3f5022b4b062 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.015667:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b200/0x825e3f5022b4b062 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.015683:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9071063d7000) 00010000:00010000:1.0:1787893051.015686:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893051.015691:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b200/0x825e3f5022b4b062 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.015697:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b200/0x825e3f5022b4b062 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787893051.015712:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000054715ff3 reply state 0000000006bd2952 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b069 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893051.015721:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787893051.016102:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4b05b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0c2 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.016116:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4b070 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0c2 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.016123:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff907105907b00) 00010000:00010000:1.0:1787893051.016125:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787893051.016128:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90710153b000, rc 0) 00000100:00100000:1.0:1787893051.016266:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907108389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+19:11367:x1874741431436288:12345-192.168.202.29@tcp:101:bash.0 Request processed in 2778us (3082us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1787893051.016289:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 143 00010000:00010000:1.0:1787893051.019068:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b069 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.019096:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b069 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.019103:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b069 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.019108:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153b600 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893051.019113:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b069 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.019120:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b069 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.019136:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff907105907e00) 00010000:00010000:1.0:1787893051.019139:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893051.019144:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b069 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.019149:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b069 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893051.023189:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893051.024480:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431436416 00000100:00100000:2.0:1787893051.024496:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431436416 00000100:00100000:2.0:1787893051.024633:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 47 00000100:00100000:2.0:1787893051.024646:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907108389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4829748d-dde1-497a-9623-0e4326f0972c+5:2360:x1874741431436416:12345-192.168.202.29@tcp:101:bash.0 00010000:00010000:2.0:1787893051.024668:0:8105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893051.024697:0:8105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a47c480/0x825e3f5022b4b07e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b0c9 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787893051.024731:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787893051.024784:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=378s v=(0 0) 00010000:00010000:2.0:1787893051.024790:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893051.024801:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a47c480/0x825e3f5022b4b07e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0c9 expref: 6 pid: 8105 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.024854:0:8105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006a47c480/0x825e3f5022b4b07e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0c9 expref: 6 pid: 8105 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.024870:0:8105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9e800, rc 0) 00000100:00100000:2.0:1787893051.024954:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907108389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4829748d-dde1-497a-9623-0e4326f0972c+6:2360:x1874741431436416:12345-192.168.202.29@tcp:101:bash.0 Request processed in 310us (1774us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893051.024961:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 47 00000100:00080000:3.0:1787893051.030138:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787893051.030369:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893051.030746:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431436544 00000100:00100000:3.0:1787893051.031049:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431436544 00000100:00100000:3.0:1787893051.031124:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 48 00000100:00100000:3.0:1787893051.031135:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f471500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4829748d-dde1-497a-9623-0e4326f0972c+6:11367:x1874741431436544:12345-192.168.202.29@tcp:101:bash.0 00010000:00010000:3.0:1787893051.031157:0:6702:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893051.031180:0:6702:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009c5a260/0x825e3f5022b4b085 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b0d0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893051.031215:0:6702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006a47c480/0x825e3f5022b4b07e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0c9 expref: 7 pid: 8105 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893051.031225:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893051.031229:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893051.031235:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009c5a260/0x825e3f5022b4b085 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0d0 expref: 7 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893051.031298:0:6702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006a47c480/0x825e3f5022b4b07e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0c9 expref: 7 pid: 8105 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893051.031314:0:6702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006a47c480/0x825e3f5022b4b07e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0c9 expref: 7 pid: 8105 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893051.031328:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e81f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6702:1874741455561344:192.168.202.29@tcp:104: 00000100:00100000:3.0:1787893051.031438:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710828d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787893051.034085:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e81f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6702:1874741455561344:192.168.202.29@tcp:104: 00010000:00010000:3.0:1787893051.034122:0:6702:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000009c5a260/0x825e3f5022b4b085 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0d0 expref: 7 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893051.034159:0:6702:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907104f47c00, rc 0) 00000100:00100000:3.0:1787893051.034217:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f471500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4829748d-dde1-497a-9623-0e4326f0972c+7:11367:x1874741431436544:12345-192.168.202.29@tcp:101:bash.0 Request processed in 3082us (3854us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893051.034227:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 48 00000100:00100000:0.0:1787893051.037079:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893051.037440:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431436672 00000100:00100000:3.0:1787893051.037452:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431436672 00010000:00010000:3.0:1787893051.037493:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006a47c480/0x825e3f5022b4b07e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0c9 expref: 7 pid: 8105 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893051.037537:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 61 00000100:00100000:3.0:1787893051.037547:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e62ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4829748d-dde1-497a-9623-0e4326f0972c+7:2360:x1874741431436672:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787893051.037564:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893051.037589:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006a47c480/0x825e3f5022b4b07e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0c9 expref: 7 pid: 8105 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893051.037602:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006a47c480/0x825e3f5022b4b07e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0c9 expref: 7 pid: 8105 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893051.037625:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a47c480/0x825e3f5022b4b07e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0c9 expref: 7 pid: 8105 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893051.037642:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893051.037646:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893051.037654:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000009c5a260/0x825e3f5022b4b085 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0d0 expref: 6 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893051.037677:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009c5a260/0x825e3f5022b4b085 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0d0 expref: 6 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893051.037718:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000009c5a260/0x825e3f5022b4b085 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0d0 expref: 6 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893051.037733:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e81f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5835:1874741455561472:192.168.202.29@tcp:105: 00000100:00100000:3.0:1787893051.038055:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710828d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787893051.042098:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893051.042179:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431436928 00000100:00100000:0.0:1787893051.042189:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431436928 00000100:00100000:1.0:1787893051.042347:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 36 00000100:00100000:1.0:1787893051.042360:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f470380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+18:11367:x1874741431436928:12345-192.168.202.29@tcp:35:bash.0 00000100:00100000:1.0:1787893051.042748:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f470380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+19:11367:x1874741431436928:12345-192.168.202.29@tcp:35:bash.0 Request processed in 389us (656us total) trans 4294967419 rc 0/0 00000100:00100000:1.0:1787893051.042787:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 36 00000100:00100000:3.0:1787893051.048102:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e81f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5835:1874741455561472:192.168.202.29@tcp:105: 00010000:00010000:3.0:1787893051.048134:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893051.049234:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e62ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4829748d-dde1-497a-9623-0e4326f0972c+6:2360:x1874741431436672:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 11675us (12151us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893051.049266:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 61 00000100:00100000:0.0:1787893051.080948:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874741455561856:0@lo:400:kworker.0 00000100:00100000:0.0:1787893051.081015:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893051.081082:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787893051.081088:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874741455561728:0@lo:400:kworker.0 00000100:00100000:0.0:1787893051.081109:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893051.081124:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9071083a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455562240:0@lo:400:kworker.0 00000100:00100000:0.0:1787893051.081143:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893051.081174:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455562240 00000100:00100000:0.0:1787893051.081180:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455562240 00000100:00100000:0.0:1787893051.081229:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787893051.081237:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907003898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455562240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893051.081447:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e62b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22d910cf-711e-44e0-9acf-212404ada550:3308:1874741455561600:0@lo:400:kworker.0 00000100:00100000:2.0:1787893051.081485:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893051.081508:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9071083a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874741455562112:0@lo:400:kworker.0 00000100:00100000:2.0:1787893051.081529:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893051.081550:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787893051.081555:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e62a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455561984:0@lo:400:kworker.0 00000100:00100000:2.0:1787893051.081577:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893051.081603:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455561984 00000100:00100000:2.0:1787893051.081607:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455561984 00000100:00100000:2.0:1787893051.081632:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787893051.081639:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f473800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455561984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893051.081693:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f473800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455561984:12345-0@lo:400:kworker.0 Request processed in 53us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893051.081710:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787893051.081791:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e62a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455561984:0@lo:400:kworker.0 00000100:00100000:2.0:1787893051.081824:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455561856 00000100:00100000:2.0:1787893051.081827:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455561856 00000100:00100000:2.0:1787893051.081849:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455561728 00000100:00100000:2.0:1787893051.081851:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455561728 00000100:00100000:2.0:1787893051.081859:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455562112 00000100:00100000:2.0:1787893051.081861:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455562112 00000100:00100000:2.0:1787893051.081873:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787893051.081878:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071083a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874741455561856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893051.081912:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071083a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874741455561856:12345-0@lo:400:kworker.0 Request processed in 34us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893051.081918:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787893051.081928:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787893051.081933:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071083a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874741455561728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893051.081953:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071083a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874741455561728:12345-0@lo:400:kworker.0 Request processed in 20us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893051.081958:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787893051.081967:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787893051.081972:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874741455562112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893051.081995:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f472300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874741455562112:12345-0@lo:400:kworker.0 Request processed in 23us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893051.082000:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787893051.082020:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9071083a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874741455562112:0@lo:400:kworker.0 00000100:00080000:2.0:1787893051.082057:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787893051.082068:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787893051.082105:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874741455561728:0@lo:400:kworker.0 00000100:00100000:2.0:1787893051.082114:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874741455561856:0@lo:400:kworker.0 00000100:00100000:0.0:1787893051.082404:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907003898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455562240:12345-0@lo:400:kworker.0 Request processed in 1167us (1259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893051.082411:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787893051.082492:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9071083a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455562240:0@lo:400:kworker.0 00000100:00100000:3.0:1787893051.082585:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455561600 00000100:00100000:3.0:1787893051.082590:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455561600 00000100:00100000:3.0:1787893051.082631:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1787893051.082640:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+19:3308:x1874741455561600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893051.082691:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+19:3308:x1874741455561600:12345-0@lo:400:kworker.0 Request processed in 52us (1205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893051.082697:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1787893051.083130:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e62b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22d910cf-711e-44e0-9acf-212404ada550:3308:1874741455561600:0@lo:400:kworker.0 00000100:00100000:2.0:1787893051.153137:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893051.153257:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431437184 00000100:00100000:0.0:1787893051.153268:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431437184 00000100:00100000:0.0:1787893051.153348:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 144 00000100:00100000:0.0:1787893051.153360:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f471c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+19:11377:x1874741431437184:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:0.0:1787893051.153386:0:8281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893051.153407:0:8281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4b08c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b0d7 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893051.153539:0:8281:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787893051.153668:0:8281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4b08c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0d7 expref: 21 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893051.153684:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907105cff800) 00010000:00010000:0.0:1787893051.153688:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787893051.153708:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4b08c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0d7 expref: 21 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893051.153727:0:8281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907137fc8400, rc 0) 00000100:00100000:0.0:1787893051.153861:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f471c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+20:11377:x1874741431437184:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 502us (734us total) trans 4294967420 rc 301/301 00000100:00100000:0.0:1787893051.153868:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 144 00000100:00100000:0.0:1787893051.157634:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893051.160386:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431437440 00000100:00100000:1.0:1787893051.160402:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431437440 00000100:00100000:1.0:1787893051.160497:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 37 00000100:00100000:1.0:1787893051.160508:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90700389a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+20:11377:x1874741431437440:12345-192.168.202.29@tcp:35:lfs.0 00000100:00100000:1.0:1787893051.161585:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90700389a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+21:11377:x1874741431437440:12345-192.168.202.29@tcp:35:lfs.0 Request processed in 1073us (3963us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1787893051.161596:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 37 00000100:00100000:3.0:1787893051.261873:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893051.262412:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431437568 00000100:00100000:2.0:1787893051.262426:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431437568 00000100:00100000:2.0:1787893051.262511:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 145 00000100:00100000:2.0:1787893051.262522:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107e81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+21:11383:x1874741431437568:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:2.0:1787893051.262547:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893051.262575:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4b09a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b0de expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.262646:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b0a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.262660:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b0a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.262673:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b0a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893051.262738:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1787893051.262743:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787893051.262984:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b0a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.263014:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4b09a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0de expref: 23 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.263057:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b0a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0de expref: 22 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.263065:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9071063d7000) 00010000:00010000:2.0:1787893051.263068:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787893051.263072:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9f200, rc 0) 00000100:00100000:2.0:1787893051.263127:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107e81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+22:11383:x1874741431437568:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 607us (1264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893051.263134:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 145 00000100:00100000:2.0:1787893051.269860:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893051.269991:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431437824 00000100:00100000:0.0:1787893051.270001:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431437824 00000100:00100000:0.0:1787893051.270066:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 146 00000100:00100000:0.0:1787893051.270076:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f471f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+22:11383:x1874741431437824:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:0.0:1787893051.270097:0:8281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893051.270119:0:8281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4b0a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b0e5 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893051.270419:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9400/0x825e3f5022b4b0af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893051.270434:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9400/0x825e3f5022b4b0af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893051.270446:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9400/0x825e3f5022b4b0af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893051.270458:0:8281:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787893051.270608:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4b0a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0e5 expref: 25 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893051.270630:0:8281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9400/0x825e3f5022b4b0af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0e5 expref: 24 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893051.270657:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff907105907b00) 00010000:00010000:0.0:1787893051.270660:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787893051.270663:0:8281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907137fc9400, rc 0) 00000100:00100000:0.0:1787893051.271003:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f471f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+24:11383:x1874741431437824:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 926us (1152us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1787893051.271012:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 146 00000100:00100000:3.0:1787893051.274684:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893051.275045:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431437952 00000100:00100000:2.0:1787893051.275057:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431437952 00000100:00100000:2.0:1787893051.275134:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 11 00000100:00100000:2.0:1787893051.275144:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107e82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4829748d-dde1-497a-9623-0e4326f0972c+24:2362:x1874741431437952:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787893051.275162:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893051.275189:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9400/0x825e3f5022b4b0af lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0e5 expref: 24 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.275210:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff907105907b00) 00010000:00010000:2.0:1787893051.275215:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893051.279155:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107e82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4829748d-dde1-497a-9623-0e4326f0972c+23:2362:x1874741431437952:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 3995us (4465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893051.279172:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 11 00000100:00100000:3.0:1787893051.281212:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893051.281506:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431438208 00000100:00100000:2.0:1787893051.281518:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431438208 00000100:00100000:2.0:1787893051.281635:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 147 00000100:00100000:2.0:1787893051.281648:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107e81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+23:11383:x1874741431438208:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:2.0:1787893051.281678:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893051.281706:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4b0bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b0ec expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.281971:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4b0c4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.281997:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4b0c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.282010:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4b0c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893051.282024:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787893051.282176:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4b0bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0ec expref: 26 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.282193:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4b0c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0ec expref: 25 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.282202:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff907105907b00) 00010000:00010000:2.0:1787893051.282205:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787893051.282209:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9ec00, rc 0) 00000100:00100000:2.0:1787893051.282380:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107e81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+25:11383:x1874741431438208:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 733us (1177us total) trans 4294967423 rc 0/0 00000100:00100000:2.0:1787893051.282388:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 147 00000100:00100000:3.0:1787893051.288039:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893051.288083:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431438336 00000100:00100000:3.0:1787893051.288094:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431438336 00000100:00100000:3.0:1787893051.288148:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 49 00000100:00100000:3.0:1787893051.288158:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f90e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4829748d-dde1-497a-9623-0e4326f0972c+6:2362:x1874741431438336:12345-192.168.202.29@tcp:1:lfs.0 00010000:00010000:3.0:1787893051.288225:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0eda736/0x825e3f5022b4b0d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893051.288262:0:6701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000009c5a260/0x825e3f5022b4b085 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0d0 expref: 6 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893051.288271:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787893051.288286:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787893051.288292:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0eda736/0x825e3f5022b4b0d2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893051.288335:0:6701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000009c5a260/0x825e3f5022b4b085 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0d0 expref: 6 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893051.288351:0:6701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000009c5a260/0x825e3f5022b4b085 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0d0 expref: 6 pid: 6702 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893051.288366:0:6701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f90f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6701:1874741455562368:192.168.202.29@tcp:104: 00000100:00100000:3.0:1787893051.288451:0:6701:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710828dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787893051.291858:0:6701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f90f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6701:1874741455562368:192.168.202.29@tcp:104: 00010000:00010000:2.0:1787893051.291907:0:6701:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e0eda736/0x825e3f5022b4b0d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893051.294054:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893051.294267:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431438464 00000100:00100000:0.0:1787893051.294288:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431438464 00002000:00100000:0.0:1787893051.294350:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff90713f90c000 x1874741431438464/t0(0) o4->4829748d-dde1-497a-9623-0e4326f0972c@192.168.202.29@tcp:212/0 lens 504/0 e 0 to 0 dl 1787893062 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787893051.294362:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90713f90c000 with x1874741431438464 ext(0->12) 00010000:00010000:0.0:1787893051.294372:0:6705:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000009c5a260/0x825e3f5022b4b085 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0d0 expref: 7 pid: 6702 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893051.294390:0:6705:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000009c5a260/0x825e3f5022b4b085 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0d0 expref: 7 pid: 6702 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787893051.294398:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90713f90c000 00000100:00100000:0.0:1787893051.294427:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 2 00000100:00100000:0.0:1787893051.294438:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f90c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4829748d-dde1-497a-9623-0e4326f0972c+7:2360:x1874741431438464:12345-192.168.202.29@tcp:4:lfs.0 00000100:00100000:0.0:1787893051.295092:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f90c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4829748d-dde1-497a-9623-0e4326f0972c+9:2360:x1874741431438464:12345-192.168.202.29@tcp:4:lfs.0 Request processed in 652us (1045us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787893051.295101:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 2 00002000:00100000:0.0:1787893051.295109:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff90713f90c000 x1874741431438464/t4294967305(0) o4->4829748d-dde1-497a-9623-0e4326f0972c@192.168.202.29@tcp:212/0 lens 504/448 e 0 to 0 dl 1787893062 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787893051.295124:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90713f90c000 with x1874741431438464 ext(0->12) 00010000:00010000:0.0:1787893051.295131:0:6705:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000009c5a260/0x825e3f5022b4b085 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0d0 expref: 9 pid: 6702 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893051.295143:0:6705:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000009c5a260/0x825e3f5022b4b085 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0d0 expref: 9 pid: 6702 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787893051.295150:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90713f90c000 00000100:00100000:3.0:1787893051.299494:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893051.299641:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431438592 00000100:00100000:2.0:1787893051.299653:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431438592 00010000:00010000:2.0:1787893051.299700:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000009c5a260/0x825e3f5022b4b085 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0d0 expref: 9 pid: 6702 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893051.299815:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 62 00000100:00100000:2.0:1787893051.299828:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f90f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4829748d-dde1-497a-9623-0e4326f0972c+9:2362:x1874741431438592:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787893051.299852:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787893051.299877:0:5834:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787893051.299880:0:5834:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787893050 00002000:00010000:2.0:1787893051.299883:0:5834:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787893051 00002000:00010000:2.0:1787893051.299885:0:5834:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787893050 00010000:00010000:2.0:1787893051.299891:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000009c5a260/0x825e3f5022b4b085 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0d0 expref: 9 pid: 6702 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.299907:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000009c5a260/0x825e3f5022b4b085 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0d0 expref: 9 pid: 6702 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.299933:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009c5a260/0x825e3f5022b4b085 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0d0 expref: 9 pid: 6702 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.299952:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787893051.299958:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787893051.299982:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e0eda736/0x825e3f5022b4b0d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.299994:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0eda736/0x825e3f5022b4b0d2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.300027:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893051.300077:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f90f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4829748d-dde1-497a-9623-0e4326f0972c+8:2362:x1874741431438592:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 252us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893051.300085:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 62 00010000:00010000:3.0:1787893051.301225:0:6701:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e0eda736/0x825e3f5022b4b0d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893051.301250:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0eda736/0x825e3f5022b4b0d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893051.301313:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0eda736/0x825e3f5022b4b0d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893051.301321:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0eda736/0x825e3f5022b4b0d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893051.301329:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0eda736/0x825e3f5022b4b0d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893051.301337:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f47600 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:3.0:1787893051.301341:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0eda736/0x825e3f5022b4b0d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893051.301350:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0eda736/0x825e3f5022b4b0d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893051.301367:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0eda736/0x825e3f5022b4b0d2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893051.301375:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0eda736/0x825e3f5022b4b0d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893051.301470:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f90e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4829748d-dde1-497a-9623-0e4326f0972c+7:2362:x1874741431438336:12345-192.168.202.29@tcp:1:lfs.0 Request processed in 13310us (13439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893051.301478:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 49 00000100:00100000:3.0:1787893051.307371:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893051.308565:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431438848 00000100:00100000:0.0:1787893051.308580:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431438848 00000100:00100000:0.0:1787893051.308704:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 38 00000100:00100000:0.0:1787893051.308716:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713044f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+25:11383:x1874741431438848:12345-192.168.202.29@tcp:35:lfs.0 00000004:00010000:0.0:1787893051.308822:0:5850:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4b0c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0ec expref: 25 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787893051.309100:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1787893051.309149:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:0.0:1787893051.309708:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00010000:00010000:0.0:1787893051.309799:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4b0d9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893051.309815:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4b070 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0c2 expref: 29 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893051.309824:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4b0d9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893051.309876:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4b070 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0c2 expref: 29 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893051.309891:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4b070 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0c2 expref: 29 pid: 5847 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893051.309908:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5850:1874741455562496:192.168.202.29@tcp:104: 00000100:00100000:0.0:1787893051.310011:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff907111b69480 going to sleep for 11 seconds 00000100:00100000:0.0:1787893051.317450:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5850:1874741455562496:192.168.202.29@tcp:104: 00010000:00010000:0.0:1787893051.317485:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4b0d9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893051.317965:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893051.318800:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431438976 00000100:00100000:2.0:1787893051.318824:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431438976 00010000:00010000:2.0:1787893051.318871:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4b070 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0c2 expref: 30 pid: 5847 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893051.318914:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 63 00000100:00100000:2.0:1787893051.318925:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f57f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4829748d-dde1-497a-9623-0e4326f0972c+30:2361:x1874741431438976:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787893051.318942:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893051.318950:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4b070 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0c2 expref: 30 pid: 5847 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.318964:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4b070 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0c2 expref: 30 pid: 5847 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.318986:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4b070 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0c2 expref: 30 pid: 5847 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.319004:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff907105907b00) 00010000:00010000:2.0:1787893051.319025:0:8463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4b0d9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.319035:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4b0d9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.319042:0:8463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4b0d9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.319066:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893051.319124:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f57f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4829748d-dde1-497a-9623-0e4326f0972c+29:2361:x1874741431438976:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 200us (1160us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893051.319132:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 63 00010000:00010000:0.0:1787893051.319832:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4b0d9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893051.319843:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4b0d9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787893051.319970:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:0.0:1787893051.320191:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1787893051.320888:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5850:1874741455562624:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787893051.320954:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893051.320987:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff907111b69000 going to sleep for 11 seconds 00000100:00100000:2.0:1787893051.321819:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455562624 00000100:00100000:2.0:1787893051.321829:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455562624 00000100:00100000:2.0:1787893051.321883:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787893051.321893:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1874741455562624:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787893051.322036:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1874741455562624:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 143us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893051.322044:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787893051.323629:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5850:1874741455562624:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787893051.324629:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:0.0:1787893051.324723:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5850:1874741455562752:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787893051.324917:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893051.324998:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff907104fcad80 going to sleep for 11 seconds 00000100:00100000:2.0:1787893051.325041:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455562752 00000100:00100000:2.0:1787893051.325049:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455562752 00000100:00100000:2.0:1787893051.325133:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787893051.325143:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5850:x1874741455562752:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787893051.325357:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5850:x1874741455562752:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 215us (439us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787893051.325366:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787893051.325465:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f0380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5850:1874741455562752:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787893051.325525:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1787893051.325576:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4b0d9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893051.325587:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4b0d9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893051.325595:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4b0d9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893051.325601:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc9800 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893051.325606:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4b0d9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893051.325613:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4b0d9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893051.325631:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff907105907b00) 00010000:00010000:3.0:1787893051.325634:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787893051.325639:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4b0d9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893051.325646:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4b0d9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787893051.325861:0:5850:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787893051.325973:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:3.0:1787893051.325986:0:5850:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 379093232715ns, next at 380093230105ns, rc = 0 00000001:00080000:3.0:1787893051.326005:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:3.0:1787893051.326043:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff907105907b00) 00010000:00010000:3.0:1787893051.326046:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787893051.326054:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4b0c4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0ec expref: 33 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893051.326166:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713044f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+32:11383:x1874741431438848:12345-192.168.202.29@tcp:35:lfs.0 Request processed in 17452us (18805us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1787893051.326174:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 38 00000020:00080000:3.0:1787893051.326178:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787893051.329105:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893051.329711:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431439104 00000100:00100000:0.0:1787893051.329727:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431439104 00000100:00100000:0.0:1787893051.330026:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 148 00000100:00100000:0.0:1787893051.330037:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f57ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+32:11383:x1874741431439104:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:0.0:1787893051.330067:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893051.330091:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9200/0x825e3f5022b4b0e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b0f3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893051.330163:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9200/0x825e3f5022b4b0e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0f3 expref: 33 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893051.330179:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9200/0x825e3f5022b4b0e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0f3 expref: 33 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893051.330200:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9071061f7b00) 00010000:00010000:0.0:1787893051.330203:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787893051.330206:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907137fc9200, rc 0) 00000100:00100000:0.0:1787893051.330301:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f57ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+33:11383:x1874741431439104:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 266us (1206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893051.330308:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 148 00000100:00100000:1.0:1787893051.334683:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893051.334797:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431439360 00000100:00100000:3.0:1787893051.334809:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431439360 00000100:00100000:3.0:1787893051.334864:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 39 00000100:00100000:3.0:1787893051.334875:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712eb57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+33:11383:x1874741431439360:12345-192.168.202.29@tcp:35:lfs.0 00000100:00100000:3.0:1787893051.335115:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712eb57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+34:11383:x1874741431439360:12345-192.168.202.29@tcp:35:lfs.0 Request processed in 241us (443us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1787893051.335123:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 39 00000100:00100000:3.0:1787893051.463955:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893051.464068:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431439616 00000100:00100000:1.0:1787893051.464080:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431439616 00000100:00100000:1.0:1787893051.464147:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 149 00000100:00100000:1.0:1787893051.464157:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f57ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+34:11393:x1874741431439616:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:1.0:1787893051.464183:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893051.464203:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b200/0x825e3f5022b4b0e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b0fa expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893051.464343:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787893051.464468:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b200/0x825e3f5022b4b0e7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0fa expref: 36 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.464484:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907105cff800) 00010000:00010000:1.0:1787893051.464487:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787893051.464493:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b200/0x825e3f5022b4b0e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0fa expref: 36 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.464509:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90710153b200, rc 0) 00000100:00100000:1.0:1787893051.464580:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f57ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+35:11393:x1874741431439616:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 424us (634us total) trans 4294967434 rc 301/301 00000100:00100000:1.0:1787893051.464588:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 149 00010000:00010000:3.0:1787893051.465900:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893051.472088:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893051.472191:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431439744 00000100:00100000:2.0:1787893051.472201:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431439744 00000100:00100000:2.0:1787893051.472301:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 150 00000100:00100000:2.0:1787893051.472312:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712eb54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+35:11393:x1874741431439744:12345-192.168.202.29@tcp:34:lfs.0 00010000:00010000:2.0:1787893051.472399:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4b0f5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.472416:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4b0f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.472429:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4b0f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.472445:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4b0fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.472453:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4b0fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.472459:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4b0fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.472568:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b103 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.472576:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b103 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.472584:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b103 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787893051.472630:0:8281:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b103 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.472643:0:8281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4b0f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.472656:0:8281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4b0f5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.472663:0:8281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4b0f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.472669:0:8281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9e200 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893051.472674:0:8281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4b0f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.472682:0:8281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4b0f5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.472696:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9071063d7000) 00010000:00010000:2.0:1787893051.472699:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893051.472704:0:8281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4b0f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.472709:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4b0f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.472725:0:8281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4b0fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.472731:0:8281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4b0fc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.472736:0:8281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4b0fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.472741:0:8281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9ea00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893051.472970:0:8281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4b0fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.472978:0:8281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4b0fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.472986:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff907105cff700) 00010000:00010000:2.0:1787893051.472988:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893051.472991:0:8281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4b0fc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.472996:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4b0fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.473011:0:8281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b103 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.473016:0:8281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b103 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.473022:0:8281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b103 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.473027:0:8281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9fc00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893051.473030:0:8281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b103 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.473035:0:8281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b103 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.473042:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9071061f7b00) 00010000:00010000:2.0:1787893051.473044:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893051.473054:0:8281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b103 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.473060:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b103 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893051.473149:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712eb54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+35:11393:x1874741431439744:12345-192.168.202.29@tcp:34:lfs.0 Request processed in 838us (1072us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893051.473157:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 150 00000100:00100000:3.0:1787893051.475903:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893051.476222:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431440000 00000100:00100000:1.0:1787893051.476233:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431440000 00000100:00100000:1.0:1787893051.476315:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 40 00000100:00100000:1.0:1787893051.476326:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90700389a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+35:11393:x1874741431440000:12345-192.168.202.29@tcp:35:lfs.0 00000100:00100000:1.0:1787893051.476603:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90700389a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+36:11393:x1874741431440000:12345-192.168.202.29@tcp:35:lfs.0 Request processed in 277us (709us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1787893051.476611:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 40 00000100:00100000:3.0:1787893051.524964:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893051.525088:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431440256 00000100:00100000:1.0:1787893051.525098:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431440256 00000100:00100000:1.0:1787893051.525164:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 151 00000100:00100000:1.0:1787893051.525174:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907139e56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+36:11396:x1874741431440256:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:1.0:1787893051.525197:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893051.525218:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b200/0x825e3f5022b4b10a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b101 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.525312:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4b111 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.525326:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4b111 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.525338:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4b111 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.525353:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b118 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.525361:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b118 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.525376:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b118 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.525510:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4b11f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.525518:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4b11f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.525525:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4b11f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893051.525535:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787893051.525637:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4b111 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.525646:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4b111 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.525652:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4b111 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.525658:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153be00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893051.525663:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4b111 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.525670:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4b111 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.525683:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9071063d7000) 00010000:00010000:1.0:1787893051.525686:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893051.525700:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4b111 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.525706:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4b111 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.525722:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b118 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.525727:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b118 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.525732:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b118 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.525737:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153b600 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893051.525740:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b118 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.525746:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b118 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.525821:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff907105907e00) 00010000:00010000:1.0:1787893051.525824:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893051.525827:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b118 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.525833:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b118 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.525879:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b200/0x825e3f5022b4b10a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b101 expref: 39 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.525910:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4b11f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b101 expref: 38 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.525918:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9071061f7b00) 00010000:00010000:1.0:1787893051.525920:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787893051.525922:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90710153a000, rc 0) 00000100:00100000:1.0:1787893051.525984:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907139e56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+38:11396:x1874741431440256:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 811us (1028us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1787893051.525991:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 151 00000100:00100000:3.0:1787893051.529942:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893051.530049:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431440384 00000100:00100000:0.0:1787893051.530059:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431440384 00000100:00100000:0.0:1787893051.530120:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 152 00000100:00100000:0.0:1787893051.530129:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907139e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+38:11396:x1874741431440384:12345-192.168.202.29@tcp:54:lfs.0 00010000:00010000:0.0:1787893051.530203:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b12d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893051.530254:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b12d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893051.530267:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b12d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893051.530315:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b12d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893051.530322:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b12d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893051.530327:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b12d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893051.530333:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc9a00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:0.0:1787893051.530338:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b12d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893051.530345:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b12d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893051.530357:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9071061f7b00) 00010000:00010000:0.0:1787893051.530360:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787893051.530364:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b12d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893051.530370:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b12d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893051.530450:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907139e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+38:11396:x1874741431440384:12345-192.168.202.29@tcp:54:lfs.0 Request processed in 321us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893051.530463:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 152 00000100:00100000:0.0:1787893051.534199:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893051.534293:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431440640 00000100:00100000:1.0:1787893051.534304:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431440640 00000100:00100000:1.0:1787893051.534372:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 41 00000100:00100000:1.0:1787893051.534384:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+38:11396:x1874741431440640:12345-192.168.202.29@tcp:35:lfs.0 00000100:00100000:1.0:1787893051.534645:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+39:11396:x1874741431440640:12345-192.168.202.29@tcp:35:lfs.0 Request processed in 263us (455us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1787893051.534653:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 41 00000100:00100000:3.0:1787893051.593049:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787893051.597073:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137e48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455562880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787893051.597159:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893051.597373:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455562880 00000100:00100000:1.0:1787893051.597383:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455562880 00000100:00100000:1.0:1787893051.597430:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787893051.597440:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907139e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455562880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787893051.597478:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787893051.597523:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907139e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455562880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893051.597530:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787893051.599618:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137e48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455562880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787893051.878019:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893051.878465:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431440896 00000100:00100000:1.0:1787893051.878584:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431440896 00000100:00100000:1.0:1787893051.878638:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 153 00000100:00100000:1.0:1787893051.878648:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907139e55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+39:11427:x1874741431440896:12345-192.168.202.29@tcp:101:cat.0 00010000:00010000:1.0:1787893051.878674:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893051.878694:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b200/0x825e3f5022b4b134 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b108 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.878847:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b13b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.878861:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b13b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.878873:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b13b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893051.878884:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787893051.879012:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b200/0x825e3f5022b4b134 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b108 expref: 42 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.879032:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b13b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b108 expref: 41 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893051.879041:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9071061f7b00) 00010000:00010000:1.0:1787893051.879044:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787893051.879048:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90710153b600, rc 0) 00000100:00100000:1.0:1787893051.879096:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907139e55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+41:11427:x1874741431440896:12345-192.168.202.29@tcp:101:cat.0 Request processed in 450us (1089us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1787893051.879102:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 153 00000100:00100000:3.0:1787893051.883097:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893051.883314:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431441152 00000100:00100000:1.0:1787893051.883338:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431441152 00000100:00100000:1.0:1787893051.883411:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 42 00000100:00100000:1.0:1787893051.883422:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907139e54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+41:11427:x1874741431441152:12345-192.168.202.29@tcp:35:cat.0 00000100:00100000:1.0:1787893051.884652:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907139e54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+42:11427:x1874741431441152:12345-192.168.202.29@tcp:35:cat.0 Request processed in 1226us (1558us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1787893051.884664:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 42 00000100:00100000:0.0:1787893051.890603:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893051.890699:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431441280 00000100:00100000:2.0:1787893051.890711:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431441280 00000100:00100000:2.0:1787893051.890837:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 12 00000100:00100000:2.0:1787893051.890849:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107fa7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4829748d-dde1-497a-9623-0e4326f0972c+42:2363:x1874741431441280:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787893051.890868:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893051.890897:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b13b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b108 expref: 42 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.890917:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9071061f7b00) 00010000:00010000:2.0:1787893051.890923:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893051.891107:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107fa7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4829748d-dde1-497a-9623-0e4326f0972c+41:2363:x1874741431441280:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 259us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893051.891115:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 12 00000100:00100000:3.0:1787893051.975409:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893051.975572:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431441536 00000100:00100000:0.0:1787893051.975584:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431441536 00000100:00100000:0.0:1787893051.975653:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 154 00000100:00100000:0.0:1787893051.975665:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907139e54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+41:11433:x1874741431441536:12345-192.168.202.29@tcp:101:dd.0 00010000:00010000:0.0:1787893051.975693:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893051.975697:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787893051.975728:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b0a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0de expref: 41 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893051.975749:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9071063d7000) 00010000:00010000:0.0:1787893051.975806:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787893051.975831:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8600/0x825e3f5022b4b149 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b10f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893051.975930:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4b150 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893051.975943:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4b11f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b101 expref: 41 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893051.976154:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4b150 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893051.976195:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4b11f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b101 expref: 41 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893051.976230:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4b11f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b101 expref: 41 pid: 5847 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893051.976256:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137e49c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1874741455563008:192.168.202.29@tcp:104: 00000100:00100000:0.0:1787893051.976360:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff907104fca6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787893051.981488:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137e49c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1874741455563008:192.168.202.29@tcp:104: 00010000:00010000:0.0:1787893051.981522:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4b150 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893051.981628:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893051.982302:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431441664 00000100:00100000:2.0:1787893051.982313:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431441664 00010000:00010000:2.0:1787893051.982357:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4b11f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b101 expref: 42 pid: 5847 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893051.982400:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 64 00000100:00100000:2.0:1787893051.982410:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907139e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4829748d-dde1-497a-9623-0e4326f0972c+42:2361:x1874741431441664:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787893051.982439:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893051.982447:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4b11f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b101 expref: 42 pid: 5847 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.982461:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4b11f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b101 expref: 42 pid: 5847 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.982483:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4b11f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b101 expref: 42 pid: 5847 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.982501:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9071061f7b00) 00010000:00010000:2.0:1787893051.982506:0:8463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4b150 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.982515:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4b150 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.982522:0:8463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4b150 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.982552:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893051.982670:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907139e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4829748d-dde1-497a-9623-0e4326f0972c+41:2361:x1874741431441664:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 260us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893051.982679:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 64 00010000:00010000:0.0:1787893051.982830:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4b150 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893051.982838:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4b150 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893051.982860:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787893051.983035:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8600/0x825e3f5022b4b149 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b10f expref: 42 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893051.983054:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4b150 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b10f expref: 41 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893051.983065:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9071061f7b00) 00010000:00010000:0.0:1787893051.983068:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787893051.983070:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907137fc9e00, rc 0) 00000100:00100000:0.0:1787893051.983100:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907139e54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+41:11433:x1874741431441536:12345-192.168.202.29@tcp:101:dd.0 Request processed in 7437us (7706us total) trans 4294967440 rc 0/0 00000100:00100000:0.0:1787893051.983119:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 154 00000100:00100000:3.0:1787893051.987985:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893051.988476:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431441920 00000100:00100000:2.0:1787893051.988488:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431441920 00000100:00100000:2.0:1787893051.988550:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 155 00000100:00100000:2.0:1787893051.988561:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907139e57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+41:11433:x1874741431441920:12345-192.168.202.29@tcp:36:dd.0 00010000:00010000:2.0:1787893051.988920:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b15e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.988937:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b15e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893051.988961:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b15e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787893051.989017:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967441 00000004:00010000:2.0:1787893051.989042:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000068075b14 reply state 00000000a2d0edc9 transno 4294967442 ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b15e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893051.989050:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787893051.989159:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907139e57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+44:11433:x1874741431441920:12345-192.168.202.29@tcp:36:dd.0 Request processed in 599us (1185us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1787893051.989166:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 155 00000020:00080000:2.0:1787893051.989171:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787893051.998989:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b15e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893051.999008:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b15e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893051.999016:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b15e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893051.999021:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9fc00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:0.0:1787893051.999026:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b15e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893051.999035:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b15e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893051.999053:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9071061f7b00) 00010000:00010000:0.0:1787893051.999056:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893051.999060:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b15e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893051.999066:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b15e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893052.422216:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893052.422779:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431442048 00000100:00100000:2.0:1787893052.422791:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431442048 00000100:00100000:2.0:1787893052.422879:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 156 00000100:00100000:2.0:1787893052.422891:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907139e54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+43:11447:x1874741431442048:12345-192.168.202.29@tcp:101:stat.0 00010000:00010000:2.0:1787893052.422922:0:8281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893052.422949:0:8281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4b165 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b116 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893052.423032:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4b16c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893052.423047:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4b16c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893052.423081:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4b16c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893052.423097:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b173 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893052.423105:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b173 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893052.423113:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b173 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893052.423214:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b17a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893052.423226:0:8281:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4b150 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b10f expref: 44 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893052.423245:0:8281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b17a lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893052.423291:0:8281:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4b150 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b10f expref: 44 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893052.423307:0:8281:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4b150 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b10f expref: 44 pid: 5849 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893052.423805:0:8281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f470a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8281:1874741455563136:192.168.202.29@tcp:104: 00000100:00100000:2.0:1787893052.423918:0:8281:0:(client.c:2715:ptlrpc_set_wait()) set ffff907107ed3d80 going to sleep for 11 seconds 00000100:00080000:3.0:1787893052.423982:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787893052.432899:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893052.432977:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431442304 00000100:00100000:0.0:1787893052.432989:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431442304 00000100:00100000:0.0:1787893052.433057:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 43 00000100:00100000:0.0:1787893052.433067:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712eb54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+45:5601:x1874741431442304:12345-192.168.202.29@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787893052.433441:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712eb54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+46:5601:x1874741431442304:12345-192.168.202.29@tcp:35:ldlm_bl.0 Request processed in 374us (554us total) trans 4294967443 rc 0/0 00000100:00100000:0.0:1787893052.433461:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 43 00000100:00100000:2.0:1787893052.434159:0:8281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f470a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8281:1874741455563136:192.168.202.29@tcp:104: 00010000:00010000:2.0:1787893052.434187:0:8281:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b17a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893052.439880:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893052.442792:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431442432 00000100:00100000:2.0:1787893052.442810:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431442432 00010000:00010000:2.0:1787893052.442857:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4b150 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b10f expref: 46 pid: 5849 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893052.442892:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 65 00000100:00100000:2.0:1787893052.442899:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137e49c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4829748d-dde1-497a-9623-0e4326f0972c+46:2360:x1874741431442432:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787893052.442912:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893052.442918:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4b150 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b10f expref: 46 pid: 5849 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893052.442929:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4b150 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b10f expref: 46 pid: 5849 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893052.442947:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4b150 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b10f expref: 46 pid: 5849 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893052.442968:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9071061f7b00) 00010000:00010000:2.0:1787893052.442974:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b17a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893052.442984:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b17a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893052.442992:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b17a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893052.443037:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893052.443102:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137e49c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4829748d-dde1-497a-9623-0e4326f0972c+45:2360:x1874741431442432:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 202us (3235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893052.443111:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 65 00010000:00010000:3.0:1787893052.443172:0:8281:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b17a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893052.443179:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b17a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893052.443226:0:8281:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787893052.443240:0:8281:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787893052.443275:0:8281:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b17a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893052.443288:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b17a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893052.443298:0:8281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4b16c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893052.443305:0:8281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4b16c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893052.443316:0:8281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4b16c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893052.443322:0:8281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9e200 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893052.443327:0:8281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4b16c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893052.443341:0:8281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4b16c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893052.443353:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9071063d7000) 00010000:00010000:3.0:1787893052.443355:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893052.443359:0:8281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4b16c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893052.443365:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4b16c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893052.443377:0:8281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b173 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893052.443382:0:8281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b173 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893052.443454:0:8281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b173 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893052.443464:0:8281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9ee00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893052.443467:0:8281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b173 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893052.443476:0:8281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b173 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893052.443484:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff907105cff700) 00010000:00010000:3.0:1787893052.443487:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893052.443489:0:8281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b173 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893052.443506:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b173 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893052.443541:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4b165 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b116 expref: 45 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893052.443555:0:8281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b17a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b116 expref: 44 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893052.443562:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9071061f7b00) 00010000:00010000:3.0:1787893052.443564:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787893052.443566:0:8281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9fc00, rc 0) 00000100:00100000:3.0:1787893052.443599:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907139e54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+44:11447:x1874741431442048:12345-192.168.202.29@tcp:101:stat.0 Request processed in 20711us (21394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893052.443606:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 156 00010000:00010000:0.0:1787893052.490180:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893052.568654:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893052.569351:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431442688 00000100:00100000:2.0:1787893052.569364:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431442688 00000100:00100000:2.0:1787893052.570051:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 157 00000100:00100000:2.0:1787893052.570065:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907139e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+44:11453:x1874741431442688:12345-192.168.202.29@tcp:36:truncate.0 00010000:00010000:2.0:1787893052.570132:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893052.570163:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b17a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b116 expref: 44 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893052.570183:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9071061f7b00) 00010000:00010000:2.0:1787893052.570188:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787893052.571273:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b181 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893052.571292:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b181 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893052.571304:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b181 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787893052.572721:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967444 00000004:00010000:2.0:1787893052.572831:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000030a161ad reply state 00000000009ccffe transno 4294967445 ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b181 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893052.572846:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787893052.573024:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907139e57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+46:11453:x1874741431442688:12345-192.168.202.29@tcp:36:truncate.0 Request processed in 2958us (4376us total) trans 4294967445 rc 0/0 00000100:00100000:2.0:1787893052.573033:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 157 00000020:00080000:2.0:1787893052.573039:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787893052.581809:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b181 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893052.581840:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b181 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893052.581849:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b181 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893052.581855:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9f200 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:0.0:1787893052.581860:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b181 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893052.581868:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b181 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893052.581888:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9071061f7b00) 00010000:00010000:0.0:1787893052.581891:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893052.581897:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b181 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893052.581904:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b181 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787893052.757445:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967443 is committed 00000020:00080000:3.0:1787893052.757465:0:5870:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff907104fca0c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1787893052.757471:0:5870:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90713f5cbe00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff907104fca780 00000020:00080000:3.0:1787893052.757474:0:5870:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90713f5cb900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff907137d35800 00000001:00080000:3.0:1787893052.757547:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967445 is committed 00000004:00080000:3.0:1787893052.757577:0:5870:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1787893052.757699:0:5881:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1787893052.757961:0:5881:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1787893052.759132:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787893052.759156:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712eb55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455563264:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787893052.759253:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893052.759357:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455563264 00000100:00100000:1.0:1787893052.759366:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455563264 00000100:00100000:1.0:1787893052.759438:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787893052.759448:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712eb56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1874741455563264:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787893052.759883:0:8105:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:1.0:1787893052.759924:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a91153a, atime: 0x6a91153b, ctime: 0x6a91153a, blocks: 0x1 00010000:00010000:1.0:1787893052.759933:0:8105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004b6a95d/0x825e3f5022b4b188 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893052.759949:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=380s v=(0 0) 00010000:00010000:1.0:1787893052.759954:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893052.759960:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004b6a95d/0x825e3f5022b4b188 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893052.759976:0:8105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004b6a95d/0x825e3f5022b4b188 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893052.760005:0:8105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004b6a95d/0x825e3f5022b4b188 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893052.760012:0:8105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004b6a95d/0x825e3f5022b4b188 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893052.760031:0:8105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:3.0:1787893052.760738:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787893052.765151:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712eb56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3308:x1874741455563264:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5692us (5885us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787893052.765168:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:1.0:1787893052.765214:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893052.765237:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004b6a95d/0x825e3f5022b4b188 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893052.765252:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153a200 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:1.0:1787893052.765258:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004b6a95d/0x825e3f5022b4b188 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893052.765280:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004b6a95d/0x825e3f5022b4b188 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893052.765306:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004b6a95d/0x825e3f5022b4b188 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893052.765314:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004b6a95d/0x825e3f5022b4b188 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893052.765356:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893052.765359:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893052.765361:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787893052.766783:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90712eb55180/2, rc 0, transno 4294967307 00000100:00100000:0.0:1787893052.766811:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712eb55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455563264:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787893052.824464:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893052.827063:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431442816 00000100:00100000:0.0:1787893052.827079:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431442816 00000100:00100000:0.0:1787893052.827169:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 158 00000100:00100000:0.0:1787893052.827181:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907139e57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+15:11467:x1874741431442816:12345-192.168.202.29@tcp:101:stat.0 00010000:00010000:0.0:1787893052.827207:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893052.827244:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8800/0x825e3f5022b4b18f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b11d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893052.828083:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4b196 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893052.828101:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4b196 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893052.828114:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4b196 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893052.828130:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8600/0x825e3f5022b4b19d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893052.828137:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8600/0x825e3f5022b4b19d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893052.828144:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8600/0x825e3f5022b4b19d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893052.832049:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b1a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893052.832071:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b1a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893052.832086:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b1a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893052.832133:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1787893052.832138:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787893052.832160:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b1a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893052.832173:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b1a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893052.832181:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4b196 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893052.832188:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4b196 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893052.832194:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4b196 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893052.832199:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc9e00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893052.832203:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4b196 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893052.832221:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4b196 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893052.832249:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9071063d7000) 00010000:00010000:2.0:1787893052.832252:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893052.832257:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4b196 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893052.832272:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4b196 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893052.832289:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8600/0x825e3f5022b4b19d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893052.832295:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8600/0x825e3f5022b4b19d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893052.832301:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8600/0x825e3f5022b4b19d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893052.832307:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc8600 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893052.832318:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8600/0x825e3f5022b4b19d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893052.832325:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8600/0x825e3f5022b4b19d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893052.832332:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9071061f7800) 00010000:00010000:2.0:1787893052.832335:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893052.832337:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8600/0x825e3f5022b4b19d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893052.832352:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8600/0x825e3f5022b4b19d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893052.832408:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8800/0x825e3f5022b4b18f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b11d expref: 17 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893052.832422:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b1a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b11d expref: 16 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893052.832429:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9071061f7b00) 00010000:00010000:2.0:1787893052.832431:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787893052.832434:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9fc00, rc 0) 00000100:00100000:2.0:1787893052.836526:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907139e57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+16:11467:x1874741431442816:12345-192.168.202.29@tcp:101:stat.0 Request processed in 9329us (12056us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893052.836542:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 158 00000100:00100000:0.0:1787893052.961182:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893052.961354:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431443072 00000100:00100000:1.0:1787893052.961365:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431443072 00000100:00100000:1.0:1787893052.961447:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 159 00000100:00100000:1.0:1787893052.961460:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137e48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+16:11477:x1874741431443072:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:1.0:1787893052.961879:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893052.961912:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4b1ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b124 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893052.962205:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1787893052.963338:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4b1ab lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b124 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893052.963375:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907105cff800) 00010000:00010000:0.0:1787893052.963378:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787893052.963863:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4b1ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b124 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893052.963885:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90710153a200, rc 0) 00000100:00100000:0.0:1787893052.964000:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137e48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+17:11477:x1874741431443072:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 2542us (2827us total) trans 4294967446 rc 301/301 00000100:00100000:0.0:1787893052.964009:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 159 00000100:00100000:3.0:1787893052.975476:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893052.975801:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431443328 00000100:00100000:0.0:1787893052.975882:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431443328 00000100:00100000:0.0:1787893052.976047:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 44 00000100:00100000:0.0:1787893052.976059:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713044b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+17:11477:x1874741431443328:12345-192.168.202.29@tcp:35:lfs.0 00000100:00100000:0.0:1787893052.977083:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713044b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+18:11477:x1874741431443328:12345-192.168.202.29@tcp:35:lfs.0 Request processed in 1019us (1610us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1787893052.977095:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 44 00000100:00100000:3.0:1787893053.059211:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893053.059337:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431443584 00000100:00100000:2.0:1787893053.059349:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431443584 00000100:00100000:2.0:1787893053.059428:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 160 00000100:00100000:2.0:1787893053.059440:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907139e54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+18:11483:x1874741431443584:12345-192.168.202.29@tcp:101:bash.0 00010000:00010000:2.0:1787893053.059465:0:8281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893053.059499:0:8281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4b1b9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b12b expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.060235:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4b1c0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.060269:0:8281:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b1a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b11d expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.060292:0:8281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4b1c0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.061725:0:8281:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b1a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b11d expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.061749:0:8281:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b1a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b11d expref: 19 pid: 5849 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893053.061783:0:8281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f470a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8281:1874741455563392:192.168.202.29@tcp:104: 00000100:00100000:2.0:1787893053.061936:0:8281:0:(client.c:2715:ptlrpc_set_wait()) set ffff907107ed30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787893053.066080:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893053.066278:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431443712 00000100:00100000:3.0:1787893053.066288:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431443712 00010000:00010000:3.0:1787893053.066332:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b1a4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b11d expref: 20 pid: 5849 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893053.066375:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 66 00000100:00100000:3.0:1787893053.066384:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712eb54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4829748d-dde1-497a-9623-0e4326f0972c+20:2360:x1874741431443712:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787893053.066399:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893053.066406:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b1a4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b11d expref: 20 pid: 5849 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893053.066419:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b1a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b11d expref: 20 pid: 5849 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893053.066441:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9071061f7b00) 00010000:00010000:3.0:1787893053.066447:0:8463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4b1c0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893053.066456:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4b1c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893053.066464:0:8463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4b1c0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893053.066482:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893053.066544:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712eb54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4829748d-dde1-497a-9623-0e4326f0972c+20:2360:x1874741431443712:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 160us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893053.066551:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 66 00010000:00010000:2.0:1787893053.067353:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b1a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b11d expref: 19 pid: 5849 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893053.067374:0:8281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f470a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8281:1874741455563392:192.168.202.29@tcp:104: 00010000:00010000:2.0:1787893053.067394:0:8281:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4b1c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.067403:0:8281:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4b1c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.067409:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4b1c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893053.067427:0:8281:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1787893053.067575:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4b1b9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b12b expref: 20 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.067609:0:8281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4b1c0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b12b expref: 19 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.067617:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9071061f7b00) 00010000:00010000:2.0:1787893053.067621:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787893053.067624:0:8281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9f600, rc 0) 00000100:00100000:2.0:1787893053.067675:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907139e54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+19:11483:x1874741431443584:12345-192.168.202.29@tcp:101:bash.0 Request processed in 8237us (8472us total) trans 4294967448 rc 0/0 00000100:00100000:2.0:1787893053.067682:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 160 00000100:00100000:1.0:1787893053.071717:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893053.072374:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431443968 00000100:00100000:2.0:1787893053.072387:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431443968 00000100:00100000:2.0:1787893053.072497:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 161 00000100:00100000:2.0:1787893053.072508:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712eb57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+19:11483:x1874741431443968:12345-192.168.202.29@tcp:36:bash.0 00010000:00010000:2.0:1787893053.073056:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4b1ce lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.073077:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4b1ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.073090:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4b1ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787893053.073148:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967449 00000004:00010000:2.0:1787893053.073174:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000430f39c reply state 000000008516040a transno 4294967450 ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4b1ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893053.073183:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787893053.073322:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712eb57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+22:11483:x1874741431443968:12345-192.168.202.29@tcp:36:bash.0 Request processed in 813us (1613us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1787893053.073330:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 161 00000020:00080000:2.0:1787893053.073335:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787893053.076090:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4b1ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893053.076115:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4b1ce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893053.076124:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4b1ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893053.076131:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9f400 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893053.076137:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4b1ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893053.076145:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4b1ce lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893053.076182:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9071061f7b00) 00010000:00010000:1.0:1787893053.076185:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893053.076190:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4b1ce lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893053.076196:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4b1ce lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893053.083384:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893053.083511:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431444096 00000100:00100000:0.0:1787893053.083521:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431444096 00000100:00100000:0.0:1787893053.083574:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 162 00000100:00100000:0.0:1787893053.083582:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712eb54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+21:11483:x1874741431444096:12345-192.168.202.29@tcp:101:bash.0 00010000:00010000:0.0:1787893053.083608:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893053.083630:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4b1d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b132 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893053.083709:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b1dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893053.083737:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4b1c0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b12b expref: 22 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893053.083748:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b1dc lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893053.084045:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4b1c0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b12b expref: 22 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893053.084059:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4b1c0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b12b expref: 22 pid: 8281 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893053.084073:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137e49f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1874741455563520:192.168.202.29@tcp:104: 00000100:00100000:0.0:1787893053.084158:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff907113d1d900 going to sleep for 11 seconds 00000100:00100000:3.0:1787893053.092707:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893053.093114:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431444224 00000100:00100000:2.0:1787893053.093125:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431444224 00010000:00010000:2.0:1787893053.093168:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4b1c0 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b12b expref: 23 pid: 8281 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893053.093215:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 67 00000100:00100000:2.0:1787893053.093334:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907139e56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4829748d-dde1-497a-9623-0e4326f0972c+23:2361:x1874741431444224:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787893053.093350:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893053.093357:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4b1c0 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b12b expref: 23 pid: 8281 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.093371:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4b1c0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b12b expref: 23 pid: 8281 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.093392:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9071061f7b00) 00010000:00010000:2.0:1787893053.093397:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b1dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.093407:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b1dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.093414:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b1dc lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.093432:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893053.093487:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907139e56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4829748d-dde1-497a-9623-0e4326f0972c+23:2361:x1874741431444224:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 262us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893053.093502:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 67 00010000:00010000:0.0:1787893053.093880:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4b1c0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b12b expref: 22 pid: 8281 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893053.093897:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137e49f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1874741455563520:192.168.202.29@tcp:104: 00010000:00010000:0.0:1787893053.094375:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b1dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893053.094386:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b1dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893053.094393:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b1dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893053.094442:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787893053.094455:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787893053.094478:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b1dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893053.094515:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4b1d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b132 expref: 22 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893053.094534:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b1dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b132 expref: 21 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893053.094543:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9071061f7b00) 00010000:00010000:0.0:1787893053.094545:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787893053.094548:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907137fc9a00, rc 0) 00000100:00100000:0.0:1787893053.094598:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712eb54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+21:11483:x1874741431444096:12345-192.168.202.29@tcp:101:bash.0 Request processed in 11016us (11224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893053.094607:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 162 00000100:00100000:3.0:1787893053.101864:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893053.102066:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431444480 00000100:00100000:1.0:1787893053.102077:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431444480 00000100:00100000:1.0:1787893053.102135:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 45 00000100:00100000:1.0:1787893053.102146:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907139e56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+21:11483:x1874741431444480:12345-192.168.202.29@tcp:35:bash.0 00000100:00100000:1.0:1787893053.102434:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907139e56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+22:11483:x1874741431444480:12345-192.168.202.29@tcp:35:bash.0 Request processed in 289us (582us total) trans 4294967451 rc 0/0 00000100:00100000:1.0:1787893053.102442:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 45 00000100:00100000:1.0:1787893053.214312:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893053.214945:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431444736 00000100:00100000:0.0:1787893053.214959:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431444736 00000100:00100000:0.0:1787893053.215037:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 163 00000100:00100000:0.0:1787893053.215049:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f535180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+22:11493:x1874741431444736:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:0.0:1787893053.215073:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893053.215096:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4b1e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b139 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893053.215404:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1787893053.215711:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4b1e3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b139 expref: 24 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893053.215727:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907105cff800) 00010000:00010000:0.0:1787893053.215737:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787893053.215743:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4b1e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b139 expref: 24 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893053.215832:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907137fc8000, rc 0) 00000100:00100000:0.0:1787893053.215919:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f535180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+23:11493:x1874741431444736:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 872us (1617us total) trans 4294967452 rc 301/301 00000100:00100000:0.0:1787893053.215927:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 163 00000100:00100000:0.0:1787893053.220153:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893053.220313:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431444864 00000100:00100000:2.0:1787893053.220324:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431444864 00000100:00100000:2.0:1787893053.220389:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 164 00000100:00100000:2.0:1787893053.220401:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137e49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+23:11493:x1874741431444864:12345-192.168.202.29@tcp:34:lfs.0 00010000:00010000:2.0:1787893053.220493:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4b1f1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.220514:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4b1f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.220527:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4b1f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.220543:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b1f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.220551:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.220560:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.220995:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b1ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.221006:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b1ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.221013:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b1ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787893053.221075:0:8281:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b1ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.221090:0:8281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4b1f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.221097:0:8281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4b1f1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.221103:0:8281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4b1f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.221108:0:8281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9ec00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893053.221113:0:8281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4b1f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.221119:0:8281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4b1f1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.221132:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9071063d7000) 00010000:00010000:2.0:1787893053.221135:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893053.221140:0:8281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4b1f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.221147:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4b1f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.221158:0:8281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b1f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.221163:0:8281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b1f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.221177:0:8281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b1f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.221181:0:8281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9fc00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893053.221184:0:8281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b1f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.221191:0:8281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b1f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.221198:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff907105cffe00) 00010000:00010000:2.0:1787893053.221200:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893053.221202:0:8281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b1f8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.221207:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b1f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.221224:0:8281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b1ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.221230:0:8281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b1ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.221236:0:8281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b1ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.221242:0:8281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9e800 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893053.221245:0:8281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b1ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.221274:0:8281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b1ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.221283:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9071061f7b00) 00010000:00010000:2.0:1787893053.221285:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893053.221288:0:8281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b1ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.221292:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b1ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893053.221377:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137e49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+23:11493:x1874741431444864:12345-192.168.202.29@tcp:34:lfs.0 Request processed in 976us (1235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893053.221386:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 164 00000100:00100000:3.0:1787893053.223900:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893053.225810:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431445120 00000100:00100000:0.0:1787893053.225832:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431445120 00000100:00100000:0.0:1787893053.225916:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 46 00000100:00100000:0.0:1787893053.225929:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907139e55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+23:11493:x1874741431445120:12345-192.168.202.29@tcp:35:lfs.0 00000100:00100000:0.0:1787893053.226503:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907139e55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+24:11493:x1874741431445120:12345-192.168.202.29@tcp:35:lfs.0 Request processed in 575us (2609us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1787893053.226512:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 46 00000100:00100000:1.0:1787893053.280136:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893053.280334:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431445376 00000100:00100000:0.0:1787893053.280346:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431445376 00000100:00100000:0.0:1787893053.280419:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 165 00000100:00100000:0.0:1787893053.280441:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f535f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+24:11496:x1874741431445376:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:0.0:1787893053.280468:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893053.280502:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4b206 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b140 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893053.280595:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4b20d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893053.280618:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4b20d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893053.280652:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4b20d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893053.280669:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9400/0x825e3f5022b4b214 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893053.280677:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9400/0x825e3f5022b4b214 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893053.280683:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9400/0x825e3f5022b4b214 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893053.281458:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4b21b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893053.281471:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4b21b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893053.281480:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4b21b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893053.281489:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787893053.281571:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4b20d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893053.281583:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4b20d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893053.281591:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4b20d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893053.281597:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc9800 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893053.281602:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4b20d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893053.281610:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4b20d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893053.281621:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9071063d7000) 00010000:00010000:1.0:1787893053.281624:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893053.281628:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4b20d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893053.281634:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4b20d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893053.281648:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9400/0x825e3f5022b4b214 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893053.281654:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9400/0x825e3f5022b4b214 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893053.281661:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9400/0x825e3f5022b4b214 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893053.281666:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc9400 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893053.281671:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9400/0x825e3f5022b4b214 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893053.281678:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9400/0x825e3f5022b4b214 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893053.281685:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9071061f7900) 00010000:00010000:1.0:1787893053.281687:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893053.281689:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9400/0x825e3f5022b4b214 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893053.281694:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9400/0x825e3f5022b4b214 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893053.281734:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4b206 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b140 expref: 27 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893053.281946:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4b21b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b140 expref: 26 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893053.281954:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9071061f7b00) 00010000:00010000:1.0:1787893053.281957:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787893053.281959:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90710153a000, rc 0) 00000100:00100000:1.0:1787893053.282122:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f535f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+26:11496:x1874741431445376:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 1692us (1994us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1787893053.282130:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 165 00000100:00100000:3.0:1787893053.286773:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893053.286859:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431445504 00000100:00100000:2.0:1787893053.286872:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431445504 00000100:00100000:2.0:1787893053.286955:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 166 00000100:00100000:2.0:1787893053.286970:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907139e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+26:11496:x1874741431445504:12345-192.168.202.29@tcp:54:lfs.0 00010000:00010000:2.0:1787893053.287073:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b229 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.287093:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b229 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.287107:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b229 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.287145:0:8281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b229 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.287173:0:8281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b229 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.287180:0:8281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b229 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.287186:0:8281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9e800 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893053.287192:0:8281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b229 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.287199:0:8281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b229 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.287213:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9071061f7b00) 00010000:00010000:2.0:1787893053.287216:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787893053.287221:0:8281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b229 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.287227:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b229 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893053.287325:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907139e55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+26:11496:x1874741431445504:12345-192.168.202.29@tcp:54:lfs.0 Request processed in 357us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893053.287334:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 166 00000100:00100000:3.0:1787893053.289969:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893053.290135:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431445760 00000100:00100000:1.0:1787893053.290148:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431445760 00000100:00100000:1.0:1787893053.290207:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 47 00000100:00100000:1.0:1787893053.290218:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907139e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+26:11496:x1874741431445760:12345-192.168.202.29@tcp:35:lfs.0 00000100:00100000:1.0:1787893053.290517:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907139e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+27:11496:x1874741431445760:12345-192.168.202.29@tcp:35:lfs.0 Request processed in 299us (559us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1787893053.290525:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 47 00000100:00100000:1.0:1787893053.293648:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893053.293726:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431445888 00000100:00100000:3.0:1787893053.293736:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431445888 00000100:00100000:3.0:1787893053.294217:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 13 00000100:00100000:3.0:1787893053.294241:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f534a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4829748d-dde1-497a-9623-0e4326f0972c+27:2361:x1874741431445888:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787893053.294267:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893053.294301:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4b21b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b140 expref: 27 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893053.294326:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9071061f7b00) 00010000:00010000:3.0:1787893053.294332:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893053.294437:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f534a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4829748d-dde1-497a-9623-0e4326f0972c+26:2361:x1874741431445888:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 199us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893053.294445:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 13 00000100:00100000:0.0:1787893053.496113:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893053.496234:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431446144 00000100:00100000:2.0:1787893053.496245:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431446144 00000100:00100000:2.0:1787893053.496323:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 167 00000100:00100000:2.0:1787893053.496333:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137e48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+26:11514:x1874741431446144:12345-192.168.202.29@tcp:101:cat.0 00010000:00010000:2.0:1787893053.496357:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893053.496392:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b230 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b147 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.496516:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b237 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.496531:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b237 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.496543:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b237 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893053.496555:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787893053.496696:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b230 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b147 expref: 29 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.496716:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b237 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b147 expref: 28 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.496726:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9071061f7b00) 00010000:00010000:2.0:1787893053.496729:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787893053.496732:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9fc00, rc 0) 00000100:00100000:2.0:1787893053.496985:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137e48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+28:11514:x1874741431446144:12345-192.168.202.29@tcp:101:cat.0 Request processed in 652us (884us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1787893053.496993:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 167 00010000:00010000:3.0:1787893053.513520:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893053.541914:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893053.542080:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431446272 00000100:00100000:2.0:1787893053.542091:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431446272 00000100:00100000:2.0:1787893053.542166:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 168 00000100:00100000:2.0:1787893053.542177:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137f7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+28:11515:x1874741431446272:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:2.0:1787893053.542222:0:8281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893053.542264:0:8281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b245 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b14e expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.542347:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4b24c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.542361:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4b24c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.542373:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4b24c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893053.542604:0:8281:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1787893053.542609:0:8281:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787893053.542686:0:8281:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4b24c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.542720:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b245 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b14e expref: 30 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.542743:0:8281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4b24c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b14e expref: 29 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893053.542821:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9071063d7000) 00010000:00010000:2.0:1787893053.542825:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787893053.542829:0:8281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9ec00, rc 0) 00000100:00100000:2.0:1787893053.542914:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137f7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+29:11515:x1874741431446272:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 737us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893053.542922:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 168 00000100:00100000:3.0:1787893053.557586:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893053.557670:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431446656 00000100:00100000:0.0:1787893053.557685:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431446656 00000100:00100000:0.0:1787893053.557800:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 48 00000100:00100000:0.0:1787893053.557811:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907139e54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+29:11515:x1874741431446656:12345-192.168.202.29@tcp:35:lfs.0 00000100:00100000:0.0:1787893053.558170:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907139e54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+30:11515:x1874741431446656:12345-192.168.202.29@tcp:35:lfs.0 Request processed in 359us (593us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1787893053.558178:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 48 00000100:00100000:1.0:1787893053.567137:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893053.567244:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431446784 00000100:00100000:3.0:1787893053.567263:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431446784 00000100:00100000:3.0:1787893053.567349:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 14 00000100:00100000:3.0:1787893053.567360:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137f7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4829748d-dde1-497a-9623-0e4326f0972c+30:11515:x1874741431446784:12345-192.168.202.29@tcp:103:lfs.0 00010000:00010000:3.0:1787893053.567814:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787893053.567848:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b1dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b132 expref: 30 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893053.567899:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b237 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b147 expref: 29 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893053.567914:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9200/0x825e3f5022b4b0e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0f3 expref: 28 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893053.567926:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9071061f7b00) 00010000:00010000:3.0:1787893053.567938:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893053.568013:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137f7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4829748d-dde1-497a-9623-0e4326f0972c+27:11515:x1874741431446784:12345-192.168.202.29@tcp:103:lfs.0 Request processed in 654us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893053.568022:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 14 00000100:00100000:2.0:1787893053.572007:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893053.572209:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431446912 00000100:00100000:0.0:1787893053.572221:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431446912 00000100:00100000:0.0:1787893053.572301:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 169 00000100:00100000:0.0:1787893053.572319:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f470a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+27:11515:x1874741431446912:12345-192.168.202.29@tcp:58:lfs.0 00010000:00010000:0.0:1787893053.572463:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4b253 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893053.572493:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4b253 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893053.572513:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4b253 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787893053.573671:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1787893053.575886:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f470a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+27:11515:x1874741431446912:12345-192.168.202.29@tcp:58:lfs.0 Request processed in 3557us (3878us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893053.575902:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 169 00000100:00100000:1.0:1787893053.605894:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893053.606239:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431447040 00000100:00100000:0.0:1787893053.606252:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431447040 00000100:00100000:0.0:1787893053.606335:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 170 00000100:00100000:0.0:1787893053.606346:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137f7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+27:11517:x1874741431447040:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:0.0:1787893053.606366:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893053.606400:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4b25a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b155 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893053.606473:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9200/0x825e3f5022b4b261 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893053.606489:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9200/0x825e3f5022b4b261 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893053.606500:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9200/0x825e3f5022b4b261 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893053.606515:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b268 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893053.606521:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b268 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893053.606546:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b268 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893053.607250:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b26f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893053.607277:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b26f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893053.607286:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b26f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893053.607326:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787893053.607330:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787893053.607349:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b26f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893053.607362:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b26f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893053.607372:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9200/0x825e3f5022b4b261 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893053.607378:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9200/0x825e3f5022b4b261 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893053.607386:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9200/0x825e3f5022b4b261 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893053.607398:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc9200 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893053.607403:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9200/0x825e3f5022b4b261 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893053.607410:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9200/0x825e3f5022b4b261 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893053.607424:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9071063d7000) 00010000:00010000:1.0:1787893053.607427:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893053.607431:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9200/0x825e3f5022b4b261 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893053.607437:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9200/0x825e3f5022b4b261 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893053.607453:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b268 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893053.607459:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b268 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893053.607466:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b268 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893053.607471:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc9a00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893053.607473:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b268 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893053.607479:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b268 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893053.607496:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9071061f7300) 00010000:00010000:1.0:1787893053.607498:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893053.607501:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b268 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893053.607507:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b268 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893053.607538:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4b25a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b155 expref: 29 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893053.607551:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b26f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b155 expref: 28 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893053.607559:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9071061f7200) 00010000:00010000:1.0:1787893053.607561:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787893053.607564:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90710153b600, rc 0) 00000100:00100000:1.0:1787893053.607681:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137f7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+28:11517:x1874741431447040:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 1336us (1797us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893053.607689:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 170 00000040:00080000:3.0:1787893053.962277:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787893053.962288:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787893053.962349:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787893053.962356:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787893053.962485:0:11693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907139e54a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1874741455563648:192.168.202.29@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787893053.964572:0:11693:0:(client.c:2715:ptlrpc_set_wait()) set ffff907109145900 going to sleep for 11 seconds 00000100:00100000:2.0:1787893053.974017:0:11693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907139e54a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1874741455563648:192.168.202.29@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787893053.988842:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893053.989557:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431447168 00000100:00100000:0.0:1787893053.989570:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431447168 00000100:00100000:0.0:1787893053.989647:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 171 00000100:00100000:0.0:1787893053.989658:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907139e54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+28:11528:x1874741431447168:12345-192.168.202.29@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787893053.989698:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787893053.989844:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907139e54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+28:11528:x1874741431447168:12345-192.168.202.29@tcp:53:lhsmtool_posix.0 Request processed in 187us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893053.989852:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 171 00000100:00100000:3.0:1787893054.004310:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893054.004394:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893054.004430:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893054.004462:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893054.004493:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431447552 00000100:00100000:3.0:1787893054.004502:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431447552 00000100:00100000:3.0:1787893054.004570:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431447424 00000100:00100000:3.0:1787893054.004574:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431447424 00000100:00100000:3.0:1787893054.004611:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 93 00000100:00100000:3.0:1787893054.004620:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070011b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4829748d-dde1-497a-9623-0e4326f0972c+6:2360:x1874741431447552:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1787893054.004694:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070011b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4829748d-dde1-497a-9623-0e4326f0972c+6:2360:x1874741431447552:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 74us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893054.004702:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 93 00000100:00100000:3.0:1787893054.004719:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 94 00000100:00100000:3.0:1787893054.004726:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070011b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4829748d-dde1-497a-9623-0e4326f0972c+7:2360:x1874741431447424:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1787893054.004792:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070011b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4829748d-dde1-497a-9623-0e4326f0972c+7:2360:x1874741431447424:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 66us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893054.004798:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 94 00000100:00100000:3.0:1787893054.004828:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431447680 00000100:00100000:3.0:1787893054.004832:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431447680 00000100:00100000:3.0:1787893054.004868:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 159 00000100:00100000:3.0:1787893054.004875:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070011b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db96701a-d972-4021-b77b-4d58b82fa12c+5:2360:x1874741431447680:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1787893054.004903:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070011b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db96701a-d972-4021-b77b-4d58b82fa12c+5:2360:x1874741431447680:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 30us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893054.004909:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 159 00000100:00080000:3.0:1787893054.004925:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787893054.004930:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787893054.004932:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787893054.005233:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431447296 00000100:00100000:0.0:1787893054.005238:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431447296 00000100:00100000:0.0:1787893054.005286:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 296 00000100:00100000:0.0:1787893054.005294:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105a0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+13:2360:x1874741431447296:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1787893054.005337:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105a0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+13:2360:x1874741431447296:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 45us (1042us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893054.005344:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 296 00000100:00100000:1.0:1787893054.031676:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893054.031740:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431447808 00000100:00100000:3.0:1787893054.031776:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431447808 00000100:00080000:1.0:1787893054.031964:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787893054.032027:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 172 00000100:00100000:3.0:1787893054.032037:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+28:11528:x1874741431447808:12345-192.168.202.29@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787893054.032109:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4b276 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.032139:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4b276 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.032152:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4b276 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.032210:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4b27d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.032333:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4b27d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.032341:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4b27d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.032368:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4b284 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.032376:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4b284 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.032382:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4b284 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893054.032415:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787893054.032419:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787893054.032431:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4b284 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.032441:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4b276 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.032457:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4b276 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.032464:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4b276 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.032470:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f47200 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893054.032474:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4b276 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.032482:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4b276 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.032494:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9071061f7700) 00010000:00010000:3.0:1787893054.032497:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893054.032501:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4b276 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.032506:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4b276 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.032530:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4b27d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.032537:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4b27d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.032542:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4b27d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.032547:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f47600 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893054.032555:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4b27d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.032561:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4b27d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.032568:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9071063d7f00) 00010000:00010000:3.0:1787893054.032570:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893054.032572:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4b27d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.032578:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4b27d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.032592:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4b284 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.032598:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4b284 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.032604:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4b284 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.032608:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f47e00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893054.032611:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4b284 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.032617:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4b284 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.032623:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9071061f7200) 00010000:00010000:3.0:1787893054.032624:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893054.032630:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4b284 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.032636:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4b284 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893054.032734:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+28:11528:x1874741431447808:12345-192.168.202.29@tcp:34:lhsmtool_posix.0 Request processed in 697us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893054.032748:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 172 00000100:00100000:2.0:1787893054.045996:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893054.046036:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431448064 00000100:00100000:2.0:1787893054.046044:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431448064 00000100:00100000:2.0:1787893054.046093:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 173 00000100:00100000:2.0:1787893054.046101:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f470700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+28:11528:x1874741431448064:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787893054.046121:0:8281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893054.046144:0:8281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fa00/0x825e3f5022b4b28b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b15c expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.046264:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b292 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.046281:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b292 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.046293:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b292 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893054.046304:0:8281:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787893054.046392:0:8281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b292 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.046399:0:8281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b292 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.046406:0:8281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b292 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.046411:0:8281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9fe00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893054.046423:0:8281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b292 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.046431:0:8281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b292 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.046443:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9071061f7200) 00010000:00010000:2.0:1787893054.046446:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787893054.046450:0:8281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b292 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.046456:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b292 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.046488:0:8281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fa00/0x825e3f5022b4b28b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b15c expref: 30 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.046497:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9071061f7700) 00010000:00010000:2.0:1787893054.046499:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787893054.046503:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fa00/0x825e3f5022b4b28b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b15c expref: 30 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.046512:0:8281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9fa00, rc 0) 00000100:00100000:2.0:1787893054.046573:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f470700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+29:11528:x1874741431448064:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 Request processed in 472us (584us total) trans 4294967458 rc 301/301 00000100:00100000:2.0:1787893054.046581:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 173 00000100:00100000:1.0:1787893054.050374:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893054.050546:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431448192 00000100:00100000:3.0:1787893054.050557:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431448192 00000100:00100000:3.0:1787893054.050615:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 174 00000100:00100000:3.0:1787893054.050625:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+29:11528:x1874741431448192:12345-192.168.202.29@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787893054.050658:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787893054.050797:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+29:11528:x1874741431448192:12345-192.168.202.29@tcp:53:lhsmtool_posix.0 Request processed in 173us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893054.050804:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 174 00000100:00100000:1.0:1787893054.054447:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893054.055191:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431448448 00000100:00100000:3.0:1787893054.055203:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431448448 00000100:00100000:3.0:1787893054.055289:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 175 00000100:00100000:3.0:1787893054.055300:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+29:11528:x1874741431448448:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787893054.055320:0:8281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893054.055323:0:8281:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787893054.055352:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4b24c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b14e expref: 29 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.055372:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9071063d7000) 00010000:00010000:3.0:1787893054.055377:0:8281:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787893054.055408:0:8281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4b2a0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b163 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787893054.060890:0:8281:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1787893054.061196:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4b2a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.061420:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4b2a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.061436:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4b2a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.061511:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4b2a0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b163 expref: 31 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.061605:0:8281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4b2a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b163 expref: 30 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.061615:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9071063d7800) 00010000:00010000:3.0:1787893054.061619:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787893054.061623:0:8281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907104f46000, rc 0) 00000100:00100000:3.0:1787893054.061708:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+30:11528:x1874741431448448:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 Request processed in 6408us (7270us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1787893054.061717:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 175 00000100:00100000:3.0:1787893054.065544:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893054.065623:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431448704 00000100:00100000:1.0:1787893054.065638:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431448704 00000100:00100000:1.0:1787893054.065705:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 176 00000100:00100000:1.0:1787893054.065717:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070011b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+30:11528:x1874741431448704:12345-192.168.202.29@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787893054.065870:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893054.065903:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4b2a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b163 expref: 30 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.065923:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9071063d7800) 00010000:00010000:1.0:1787893054.065937:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787893054.065967:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4b2b5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.065982:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4b2b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.065992:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4b2b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.066051:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4b2bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xd7892ac7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.066058:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4b2bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd7892ac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.066064:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4b2bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd7892ac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.066796:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4b2b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.066807:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4b2b5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.066814:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4b2b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.066825:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153be00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893054.067391:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4b2b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.067403:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4b2b5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.067418:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9071063d7000) 00010000:00010000:1.0:1787893054.067421:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893054.067425:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4b2b5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.067432:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4b2b5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.067443:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4b2bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd7892ac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.067449:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4b2bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd7892ac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.067455:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4b2bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd7892ac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.067461:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153a200 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893054.067464:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4b2bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd7892ac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.067470:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4b2bc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd7892ac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.067489:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xd7892ac7 (ffff907105907400) 00010000:00010000:1.0:1787893054.067491:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893054.067494:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4b2bc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd7892ac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.067499:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4b2bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd7892ac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893054.067608:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070011b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+29:11528:x1874741431448704:12345-192.168.202.29@tcp:36:lhsmtool_posix.0 Request processed in 1890us (2085us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787893054.067616:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 176 00000100:00100000:2.0:1787893054.076798:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893054.077197:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431448832 00000100:00100000:1.0:1787893054.077209:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431448832 00000100:00100000:1.0:1787893054.077283:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 177 00000100:00100000:1.0:1787893054.077294:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f472d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+29:11528:x1874741431448832:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787893054.077314:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893054.077339:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4b2c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b16a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.077377:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4b2ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.077391:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4b2ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.077402:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4b2ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.077503:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a200/0x825e3f5022b4b2c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b16a expref: 31 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.077545:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4b2ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b16a expref: 30 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.077556:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff907105907400) 00010000:00010000:1.0:1787893054.077558:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787893054.077562:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90710153be00, rc 0) 00000100:00100000:1.0:1787893054.077634:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f472d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+30:11528:x1874741431448832:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 Request processed in 342us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893054.077642:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 177 00000100:00100000:2.0:1787893054.086470:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893054.089359:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431449088 00000100:00100000:1.0:1787893054.089378:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431449088 00000100:00100000:0.0:1787893054.093392:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 178 00000100:00100000:0.0:1787893054.093411:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f473100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+30:11528:x1874741431449088:12345-192.168.202.29@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787893054.093503:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4b2d1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893054.093635:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4b2d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893054.093669:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4b2d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787893054.094065:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:0.0:1787893054.094079:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 381861326083ns, next at 382861323052ns, rc = 0 00000004:00010000:0.0:1787893054.094377:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000714703f1 reply state 000000000ef104b8 transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4b2d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893054.094389:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787893054.094513:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f473100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+32:11528:x1874741431449088:12345-192.168.202.29@tcp:36:lhsmtool_posix.0 Request processed in 1105us (8052us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1787893054.097962:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 178 00000100:00100000:0.0:1787893054.102067:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893054.102631:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431449216 00000100:00100000:3.0:1787893054.102641:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431449216 00010000:00010000:1.0:1787893054.102693:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4b2d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893054.102707:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 179 00010000:00010000:1.0:1787893054.102707:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4b2d1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.102715:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4b2d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893054.102717:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90700389a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+32:11528:x1874741431449216:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787893054.102721:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc9800 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893054.102725:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4b2d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.102732:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4b2d1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.102778:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893054.102789:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff907105907400) 00010000:00010000:3.0:1787893054.102797:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4b2d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b171 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.102798:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787893054.102804:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4b2d1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.102809:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9800/0x825e3f5022b4b2d1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.102854:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4b2d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b171 expref: 32 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.102867:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4b2d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b171 expref: 32 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.102888:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff907105907400) 00010000:00010000:3.0:1787893054.102890:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787893054.102893:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907104f47c00, rc 0) 00000100:00100000:3.0:1787893054.102960:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90700389a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+32:11528:x1874741431449216:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 Request processed in 244us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893054.102967:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 179 00000100:00100000:1.0:1787893054.111182:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893054.111427:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431449344 00000100:00100000:2.0:1787893054.111437:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431449344 00000100:00100000:2.0:1787893054.111539:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 51 00000100:00100000:2.0:1787893054.111551:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4829748d-dde1-497a-9623-0e4326f0972c+6:2360:x1874741431449344:12345-192.168.202.29@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787893054.111930:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4829748d-dde1-497a-9623-0e4326f0972c+7:2360:x1874741431449344:12345-192.168.202.29@tcp:2:lhsmtool_posix.0 Request processed in 379us (753us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1787893054.111938:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 51 00000100:00100000:1.0:1787893054.119591:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893054.119705:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431449600 00000100:00100000:0.0:1787893054.119716:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431449600 00000100:00100000:1.0:1787893054.119999:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 49 00000100:00100000:1.0:1787893054.120012:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f565c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+32:11528:x1874741431449600:12345-192.168.202.29@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787893054.120537:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f565c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+33:11528:x1874741431449600:12345-192.168.202.29@tcp:35:lhsmtool_posix.0 Request processed in 527us (956us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1787893054.120545:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 49 00000100:00100000:2.0:1787893054.124845:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893054.124888:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431449856 00000100:00100000:2.0:1787893054.124898:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431449856 00000100:00100000:2.0:1787893054.124951:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 180 00000100:00100000:2.0:1787893054.124962:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f470000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+33:11528:x1874741431449856:12345-192.168.202.29@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787893054.125082:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f470000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+33:11528:x1874741431449856:12345-192.168.202.29@tcp:57:lhsmtool_posix.0 Request processed in 121us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893054.125090:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 180 00000100:00100000:3.0:1787893054.140890:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893054.140987:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431449984 00000100:00100000:0.0:1787893054.140998:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431449984 00000100:00100000:0.0:1787893054.141058:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 181 00000100:00100000:0.0:1787893054.141067:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070011b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+33:11528:x1874741431449984:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787893054.141087:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893054.141107:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8800/0x825e3f5022b4b2df lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b178 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893054.141208:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8600/0x825e3f5022b4b2e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893054.141231:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8600/0x825e3f5022b4b2e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893054.141359:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8600/0x825e3f5022b4b2e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893054.141395:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787893054.141411:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8600/0x825e3f5022b4b2e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893054.141436:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8800/0x825e3f5022b4b2df lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b178 expref: 35 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893054.141454:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8600/0x825e3f5022b4b2e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b178 expref: 34 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893054.141462:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff907105907400) 00010000:00010000:0.0:1787893054.141465:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787893054.141468:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907137fc8600, rc 0) 00000100:00100000:0.0:1787893054.141518:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070011b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+34:11528:x1874741431449984:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 Request processed in 453us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893054.141525:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 181 00000100:00100000:1.0:1787893054.155767:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893054.156376:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431450112 00000100:00100000:3.0:1787893054.156387:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431450112 00000100:00100000:3.0:1787893054.156458:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 52 00000100:00100000:3.0:1787893054.156469:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f564e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4829748d-dde1-497a-9623-0e4326f0972c+7:2361:x1874741431450112:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787893054.156487:0:8105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893054.156506:0:8105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000665df7fc/0x825e3f5022b4b2ed lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b17f expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787893054.156533:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a91153d, blocks: 0x1 00010000:00010000:3.0:1787893054.156551:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=381s v=(0 0) 00010000:00010000:3.0:1787893054.156562:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893054.156574:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000665df7fc/0x825e3f5022b4b2ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b17f expref: 8 pid: 8105 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.156595:0:8105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000665df7fc/0x825e3f5022b4b2ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b17f expref: 8 pid: 8105 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.156608:0:8105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907104f47e00, rc 0) 00000100:00100000:3.0:1787893054.156679:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f564e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4829748d-dde1-497a-9623-0e4326f0972c+8:2361:x1874741431450112:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 Request processed in 211us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893054.156686:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 52 00000100:00100000:2.0:1787893054.163085:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893054.163232:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431450368 00000100:00100000:3.0:1787893054.163242:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431450368 00000100:00100000:3.0:1787893054.163310:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 182 00000100:00100000:3.0:1787893054.163322:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f473480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+34:11528:x1874741431450368:12345-192.168.202.29@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787893054.163452:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f473480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+34:11528:x1874741431450368:12345-192.168.202.29@tcp:57:lhsmtool_posix.0 Request processed in 132us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893054.163460:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 182 00000100:00100000:2.0:1787893054.195581:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893054.195717:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431450496 00000100:00100000:3.0:1787893054.195733:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431450496 00000100:00100000:3.0:1787893054.195827:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 53 00000100:00100000:3.0:1787893054.195840:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f473b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4829748d-dde1-497a-9623-0e4326f0972c+8:11528:x1874741431450496:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787893054.195865:0:6702:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893054.195889:0:6702:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0eda736/0x825e3f5022b4b2f4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b186 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.195949:0:6702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000665df7fc/0x825e3f5022b4b2ed lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b17f expref: 9 pid: 8105 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.195959:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893054.195964:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893054.195969:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0eda736/0x825e3f5022b4b2f4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b186 expref: 9 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.196007:0:6702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000665df7fc/0x825e3f5022b4b2ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b17f expref: 9 pid: 8105 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.196023:0:6702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000665df7fc/0x825e3f5022b4b2ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b17f expref: 9 pid: 8105 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893054.196040:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070011b5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6702:1874741455563776:192.168.202.29@tcp:104: 00000100:00100000:3.0:1787893054.196139:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set ffff907109145900 going to sleep for 11 seconds 00000100:00100000:1.0:1787893054.208651:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893054.209840:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070011b5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6702:1874741455563776:192.168.202.29@tcp:104: 00010000:00010000:2.0:1787893054.209882:0:6702:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e0eda736/0x825e3f5022b4b2f4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b186 expref: 9 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.209904:0:6702:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907104f47600, rc 0) 00000100:00100000:2.0:1787893054.209974:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f473b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4829748d-dde1-497a-9623-0e4326f0972c+9:11528:x1874741431450496:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 Request processed in 14136us (14405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893054.209983:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 53 00000100:00100000:2.0:1787893054.210852:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431450624 00000100:00100000:2.0:1787893054.210863:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431450624 00010000:00010000:2.0:1787893054.210917:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000665df7fc/0x825e3f5022b4b2ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b17f expref: 9 pid: 8105 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893054.210959:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 68 00000100:00100000:2.0:1787893054.210969:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107fa4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4829748d-dde1-497a-9623-0e4326f0972c+9:2360:x1874741431450624:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787893054.210983:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893054.211006:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000665df7fc/0x825e3f5022b4b2ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b17f expref: 9 pid: 8105 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.211020:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000665df7fc/0x825e3f5022b4b2ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b17f expref: 9 pid: 8105 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.211044:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000665df7fc/0x825e3f5022b4b2ed lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b17f expref: 9 pid: 8105 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.211058:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893054.211062:0:8463:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893054.211069:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e0eda736/0x825e3f5022b4b2f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b186 expref: 8 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.211079:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0eda736/0x825e3f5022b4b2f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b186 expref: 8 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.211114:0:8463:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e0eda736/0x825e3f5022b4b2f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b186 expref: 8 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893054.211141:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f470e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8463:1874741455563904:192.168.202.29@tcp:105: 00000100:00100000:2.0:1787893054.211243:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff907107ed3000 going to sleep for 11 seconds 00000100:00100000:0.0:1787893054.232820:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893054.232966:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431450752 00000100:00100000:2.0:1787893054.232977:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431450752 00002000:00100000:2.0:1787893054.233035:0:6707:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff90712e2f1880 x1874741431450752/t0(0) o4->4829748d-dde1-497a-9623-0e4326f0972c@192.168.202.29@tcp:215/0 lens 504/0 e 0 to 0 dl 1787893065 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787893054.233046:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90712e2f1880 with x1874741431450752 ext(0->8) 00002000:00010000:2.0:1787893054.233053:0:6707:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90712e2f1880 00000100:00100000:2.0:1787893054.233087:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 4 00000100:00100000:2.0:1787893054.233097:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4829748d-dde1-497a-9623-0e4326f0972c+9:2361:x1874741431450752:12345-192.168.202.29@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787893054.234618:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4829748d-dde1-497a-9623-0e4326f0972c+11:2361:x1874741431450752:12345-192.168.202.29@tcp:4:lhsmtool_posix.0 Request processed in 1513us (1799us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1787893054.234631:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 4 00002000:00100000:2.0:1787893054.234640:0:6707:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff90712e2f1880 x1874741431450752/t4294967314(0) o4->4829748d-dde1-497a-9623-0e4326f0972c@192.168.202.29@tcp:215/0 lens 504/448 e 0 to 0 dl 1787893065 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787893054.234650:0:6707:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90712e2f1880 with x1874741431450752 ext(0->8) 00002000:00010000:2.0:1787893054.234655:0:6707:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90712e2f1880 00000100:00100000:3.0:1787893054.245165:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f470e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8463:1874741455563904:192.168.202.29@tcp:105: 00010000:00010000:3.0:1787893054.245195:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893054.245281:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107fa4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4829748d-dde1-497a-9623-0e4326f0972c+10:2360:x1874741431450624:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 34312us (36640us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893054.245292:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 68 00000100:00100000:3.0:1787893054.245892:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893054.251349:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431450880 00000100:00100000:3.0:1787893054.251363:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431450880 00000100:00100000:3.0:1787893054.251439:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 183 00000100:00100000:3.0:1787893054.251450:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070011b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+34:11528:x1874741431450880:12345-192.168.202.29@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787893054.350432:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:3.0:1787893054.350448:0:5870:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:3.0:1787893054.350483:0:5870:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:3.0:1787893054.350500:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967461 is committed 00000020:00080000:3.0:1787893054.350535:0:5881:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1787893054.350544:0:5881:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1787893054.350782:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070011b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+18:11528:x1874741431450880:12345-192.168.202.29@tcp:44:lhsmtool_posix.0 Request processed in 99289us (104846us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893054.350795:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 183 00000100:00100000:1.0:1787893054.351101:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787893054.351120:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f565880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455564032:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787893054.351521:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893054.351597:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455564032 00000100:00100000:1.0:1787893054.351606:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455564032 00000100:00100000:1.0:1787893054.351671:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787893054.351681:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f566300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455564032:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787893054.352690:0:8105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787893054.352698:0:8105:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787893054 00002000:00010000:1.0:1787893054.352701:0:8105:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787893054.352703:0:8105:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787893053 -> 1787893054 00002000:00010000:1.0:1787893054.352705:0:8105:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00080000:2.0:1787893054.353187:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787893054.357273:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f566300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1874741455564032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 5579us (5739us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1787893054.357289:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:2.0:1787893054.358091:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90713f565880/2, rc 0, transno 4294967315 00000100:00100000:2.0:1787893054.358102:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f565880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455564032:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787893054.359395:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893054.359468:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431451008 00000100:00100000:2.0:1787893054.359480:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431451008 00000100:00100000:2.0:1787893054.359543:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 55 00000100:00100000:2.0:1787893054.359554:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070011b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4829748d-dde1-497a-9623-0e4326f0972c+10:2363:x1874741431451008:12345-192.168.202.29@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787893054.437013:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070011b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4829748d-dde1-497a-9623-0e4326f0972c+10:2363:x1874741431451008:12345-192.168.202.29@tcp:16:lhsmtool_posix.0 Request processed in 77444us (77609us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893054.437030:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 55 00000001:00080000:0.0:1787893054.437338:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:0.0:1787893054.437354:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:3.0:1787893054.440035:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893054.440656:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431451264 00000100:00100000:2.0:1787893054.440670:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431451264 00000100:00100000:2.0:1787893054.441735:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 184 00000100:00100000:2.0:1787893054.441774:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070011b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+18:11528:x1874741431451264:12345-192.168.202.29@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787893054.441836:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893054.441871:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8600/0x825e3f5022b4b2e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b178 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.441893:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff907105907400) 00010000:00010000:2.0:1787893054.441898:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787893054.441934:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b2fb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.441949:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b2fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.441958:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b2fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787893054.442269:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000596c4cad reply state 0000000095da625b transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b2fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893054.442280:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787893054.442403:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070011b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+19:11528:x1874741431451264:12345-192.168.202.29@tcp:36:lhsmtool_posix.0 Request processed in 648us (2377us total) trans 4294967462 rc 0/0 00000100:00100000:2.0:1787893054.453061:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 184 00010000:00010000:2.0:1787893054.453979:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b2fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.453996:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b2fb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.454006:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b2fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.454012:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9ee00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893054.454017:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b2fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.454024:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b2fb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.454042:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff907105907400) 00010000:00010000:2.0:1787893054.454045:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893054.454050:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b2fb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.454056:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b2fb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893054.480119:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893054.480171:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431451392 00000100:00100000:2.0:1787893054.480184:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431451392 00000100:00100000:2.0:1787893054.480243:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 56 00000100:00100000:2.0:1787893054.480263:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f472680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4829748d-dde1-497a-9623-0e4326f0972c+7:2361:x1874741431451392:12345-192.168.202.29@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787893054.480524:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1787893054.480528:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787893054 -> 1787893052 00002000:00010000:2.0:1787893054.480531:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787893051 00002000:00010000:2.0:1787893054.480533:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787893054 -> 1787893052 00002000:00010000:2.0:1787893054.480535:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787893054.480595:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f472680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4829748d-dde1-497a-9623-0e4326f0972c+8:2361:x1874741431451392:12345-192.168.202.29@tcp:2:lhsmtool_posix.0 Request processed in 333us (487us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787893054.480604:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 56 00000100:00100000:2.0:1787893054.485200:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893054.485375:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431451648 00000100:00100000:1.0:1787893054.485386:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431451648 00000100:00100000:1.0:1787893054.485455:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 185 00000100:00100000:1.0:1787893054.485465:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f470e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+18:11528:x1874741431451648:12345-192.168.202.29@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787893054.485549:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4b302 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.485568:0:8281:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4b2ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b16a expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.485577:0:8281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4b302 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.485639:0:8281:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4b2ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b16a expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.485653:0:8281:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4b2ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b16a expref: 18 pid: 5849 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893054.485669:0:8281:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907003264380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8281:1874741455564160:192.168.202.29@tcp:104: 00000100:00100000:1.0:1787893054.485789:0:8281:0:(client.c:2715:ptlrpc_set_wait()) set ffff90713f4daf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787893054.493717:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893054.494085:0:8281:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907003264380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8281:1874741455564160:192.168.202.29@tcp:104: 00010000:00010000:2.0:1787893054.494116:0:8281:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4b302 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893054.494462:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431451776 00000100:00100000:0.0:1787893054.494469:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431451776 00010000:00010000:0.0:1787893054.494510:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4b2ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b16a expref: 19 pid: 5849 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893054.494553:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 69 00000100:00100000:0.0:1787893054.494569:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907003266300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4829748d-dde1-497a-9623-0e4326f0972c+19:2360:x1874741431451776:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893054.494585:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893054.494592:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4b2ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b16a expref: 19 pid: 5849 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893054.494605:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4b2ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b16a expref: 19 pid: 5849 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893054.494628:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4b2ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b16a expref: 19 pid: 5849 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893054.494643:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff907105907400) 00010000:00010000:0.0:1787893054.494648:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4b302 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893054.494670:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4b302 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893054.494678:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4b302 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893054.494708:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893054.494791:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907003266300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4829748d-dde1-497a-9623-0e4326f0972c+18:2360:x1874741431451776:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 223us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893054.494799:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 69 00010000:00010000:1.0:1787893054.495652:0:8281:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4b302 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.495664:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4b302 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.495707:0:8281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4b302 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.495714:0:8281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4b302 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.495720:0:8281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4b302 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.495726:0:8281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153bc00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893054.495730:0:8281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4b302 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.495745:0:8281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4b302 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.495781:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff907105907400) 00010000:00010000:1.0:1787893054.495784:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787893054.495788:0:8281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4b302 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.495795:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4b302 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893054.496046:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f470e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+17:11528:x1874741431451648:12345-192.168.202.29@tcp:55:lhsmtool_posix.0 Request processed in 10579us (10854us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787893054.496055:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 185 00000100:00100000:1.0:1787893054.516024:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893054.516068:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431451904 00000100:00100000:1.0:1787893054.516080:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431451904 00000100:00100000:1.0:1787893054.516171:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 57 00000100:00100000:1.0:1787893054.516183:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907003267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4829748d-dde1-497a-9623-0e4326f0972c+8:2363:x1874741431451904:12345-192.168.202.29@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787893054.516235:0:6702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000662e02ea/0x825e3f5022b4b309 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.516270:0:6702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e0eda736/0x825e3f5022b4b2f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b186 expref: 8 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.516280:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787893054.516285:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787893054.516290:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000662e02ea/0x825e3f5022b4b309 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.516330:0:6702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e0eda736/0x825e3f5022b4b2f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b186 expref: 8 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.516343:0:6702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e0eda736/0x825e3f5022b4b2f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b186 expref: 8 pid: 6702 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893054.516358:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907003265c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6702:1874741455564288:192.168.202.29@tcp:104: 00000100:00100000:1.0:1787893054.516444:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set ffff90713f4da180 going to sleep for 11 seconds 00000100:00100000:1.0:1787893054.521422:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893054.521535:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907003265c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6702:1874741455564288:192.168.202.29@tcp:104: 00010000:00010000:3.0:1787893054.521565:0:6702:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000662e02ea/0x825e3f5022b4b309 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893054.521926:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431452032 00000100:00100000:0.0:1787893054.521935:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431452032 00010000:00010000:0.0:1787893054.521980:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e0eda736/0x825e3f5022b4b2f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b186 expref: 9 pid: 6702 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893054.522051:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 70 00000100:00100000:0.0:1787893054.522064:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907003265f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4829748d-dde1-497a-9623-0e4326f0972c+9:2360:x1874741431452032:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893054.522085:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893054.522119:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e0eda736/0x825e3f5022b4b2f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b186 expref: 9 pid: 6702 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893054.522132:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e0eda736/0x825e3f5022b4b2f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b186 expref: 9 pid: 6702 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893054.522177:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0eda736/0x825e3f5022b4b2f4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b186 expref: 9 pid: 6702 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893054.522196:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787893054.522200:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787893054.522207:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000662e02ea/0x825e3f5022b4b309 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893054.522227:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000662e02ea/0x825e3f5022b4b309 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893054.522267:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893054.522326:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907003265f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4829748d-dde1-497a-9623-0e4326f0972c+8:2360:x1874741431452032:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 263us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893054.522333:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 70 00010000:00010000:1.0:1787893054.523616:0:6702:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000662e02ea/0x825e3f5022b4b309 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.523633:0:6702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000662e02ea/0x825e3f5022b4b309 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.523674:0:6702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000662e02ea/0x825e3f5022b4b309 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.523682:0:6702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000662e02ea/0x825e3f5022b4b309 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.523691:0:6702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000662e02ea/0x825e3f5022b4b309 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.523698:0:6702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153bc00 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:1.0:1787893054.523703:0:6702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000662e02ea/0x825e3f5022b4b309 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.523711:0:6702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000662e02ea/0x825e3f5022b4b309 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.523728:0:6702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000662e02ea/0x825e3f5022b4b309 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.523736:0:6702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000662e02ea/0x825e3f5022b4b309 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893054.523833:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907003267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4829748d-dde1-497a-9623-0e4326f0972c+7:2363:x1874741431451904:12345-192.168.202.29@tcp:1:lhsmtool_posix.0 Request processed in 7649us (7816us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893054.523842:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 57 00000100:00100000:1.0:1787893054.540393:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893054.542533:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431452288 00000100:00100000:2.0:1787893054.542546:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431452288 00000100:00100000:2.0:1787893054.542625:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 186 00000100:00100000:2.0:1787893054.542636:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907003264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+17:11528:x1874741431452288:12345-192.168.202.29@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787893054.542724:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4b310 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.542742:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4b310 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.542774:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4b310 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.543056:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4b317 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.543075:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4b2d8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b171 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.543082:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4b317 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.543119:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4b2d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b171 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.543134:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4b2d8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b171 expref: 18 pid: 5849 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893054.543149:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f470380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1874741455564416:192.168.202.29@tcp:104: 00000100:00100000:2.0:1787893054.543258:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710706a240 going to sleep for 11 seconds 00000100:00100000:3.0:1787893054.548013:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f470380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1874741455564416:192.168.202.29@tcp:104: 00010000:00010000:3.0:1787893054.548045:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4b317 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.549476:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893054.550115:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893054.551316:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431452416 00000100:00100000:1.0:1787893054.551329:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431452416 00010000:00010000:1.0:1787893054.551374:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4b2d8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b171 expref: 19 pid: 5849 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893054.551435:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 71 00000100:00100000:1.0:1787893054.551445:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f470380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4829748d-dde1-497a-9623-0e4326f0972c+19:2361:x1874741431452416:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893054.551459:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893054.551466:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4b2d8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b171 expref: 19 pid: 5849 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.551478:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4b2d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b171 expref: 19 pid: 5849 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.551498:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4b2d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b171 expref: 19 pid: 5849 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.551515:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff907105907400) 00010000:00010000:1.0:1787893054.551520:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4b317 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.551528:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4b317 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.551536:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4b317 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.551557:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893054.551620:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f470380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4829748d-dde1-497a-9623-0e4326f0972c+18:2361:x1874741431452416:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 177us (1514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893054.551627:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 71 00010000:00010000:1.0:1787893054.551934:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4b317 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.551944:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4b317 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787893054.552159:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1787893054.552352:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:1.0:1787893054.552398:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1787893054.552489:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907003264700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5848:1874741455564544:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787893054.552544:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893054.552581:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff90713f4da240 going to sleep for 11 seconds 00000100:00100000:3.0:1787893054.552920:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455564544 00000100:00100000:3.0:1787893054.552928:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455564544 00000100:00100000:3.0:1787893054.552971:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787893054.552979:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907003266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1874741455564544:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787893054.553046:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907003266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1874741455564544:12345-0@lo:1000:mdt00_001.0 Request processed in 68us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893054.553062:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787893054.554349:0:5848:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1787893054.554359:0:5848:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90713f565880, transno 4294967315 00000100:00100000:1.0:1787893054.554375:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907003264700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5848:1874741455564544:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1787893054.554914:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:1.0:1787893054.555005:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907003264700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5848:1874741455564672:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787893054.555068:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893054.555100:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff90713f4da780 going to sleep for 11 seconds 00000100:00100000:1.0:1787893054.555454:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455564672 00000100:00100000:1.0:1787893054.555462:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455564672 00000100:00100000:1.0:1787893054.555510:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787893054.555520:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907003267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1874741455564672:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787893054.555733:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907003267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5848:x1874741455564672:12345-0@lo:1000:mdt00_001.0 Request processed in 213us (664us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1787893054.555766:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787893054.556125:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907003264700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5848:1874741455564672:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1787893054.556169:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4b317 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.556179:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4b317 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.556188:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4b317 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.556195:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9f600 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893054.556200:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4b317 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.556230:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4b317 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.556255:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff907105907400) 00010000:00010000:2.0:1787893054.556259:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787893054.556263:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4b317 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.556269:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4b317 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.556299:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4b253 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.556305:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4b253 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.556312:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4b253 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.556317:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc8400 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893054.556319:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4b253 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.556325:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4b253 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.556332:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9071061f7200) 00010000:00010000:2.0:1787893054.556334:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787893054.556336:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4b253 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.556350:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4b253 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.556374:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b31e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.556387:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b26f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b155 expref: 21 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.556397:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b31e lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.556425:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b26f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b155 expref: 21 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.556440:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b26f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b155 expref: 21 pid: 5849 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893054.556452:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e82a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1874741455564800:192.168.202.29@tcp:104: 00000100:00100000:2.0:1787893054.556525:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710706a900 going to sleep for 11 seconds 00000100:00100000:1.0:1787893054.569488:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893054.569526:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431452544 00000100:00100000:1.0:1787893054.569536:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431452544 00010000:00010000:1.0:1787893054.569580:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b26f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b155 expref: 22 pid: 5849 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893054.569617:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 72 00000100:00100000:1.0:1787893054.569627:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907003264000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4829748d-dde1-497a-9623-0e4326f0972c+22:2361:x1874741431452544:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893054.569642:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893054.569650:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b26f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b155 expref: 22 pid: 5849 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.569666:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b26f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b155 expref: 22 pid: 5849 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.569689:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9071061f7200) 00010000:00010000:1.0:1787893054.569694:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b31e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.569705:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b31e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.569713:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b31e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.569732:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893054.569806:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907003264000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4829748d-dde1-497a-9623-0e4326f0972c+22:2361:x1874741431452544:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 178us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893054.569820:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 72 00010000:00010000:0.0:1787893054.570069:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b26f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b155 expref: 21 pid: 5849 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893054.570086:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e82a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1874741455564800:192.168.202.29@tcp:104: 00010000:00010000:0.0:1787893054.570110:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b31e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893054.570120:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b31e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893054.570125:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b31e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893054.570138:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b31e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893054.570144:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b31e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893054.570150:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b31e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893054.570156:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9e800 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:0.0:1787893054.570161:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b31e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893054.570169:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b31e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893054.570179:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9071061f7200) 00010000:00010000:0.0:1787893054.570181:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893054.570193:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b31e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893054.570199:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b31e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893054.570220:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4b310 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893054.570227:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4b310 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893054.570232:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4b310 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893054.570236:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9f400 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:0.0:1787893054.570239:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4b310 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893054.570274:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4b310 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893054.570282:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9071061f7200) 00010000:00010000:0.0:1787893054.570284:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787893054.570287:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4b310 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893054.570293:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4b310 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893054.570526:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907003264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+20:11528:x1874741431452288:12345-192.168.202.29@tcp:57:lhsmtool_posix.0 Request processed in 27892us (30144us total) trans 4294967467 rc 0/0 00000100:00100000:0.0:1787893054.570535:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 186 00000020:00080000:0.0:1787893054.570545:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787893054.571042:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787893054.571048:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787893054.573664:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1787893054.573685:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787893054.577650:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893054.577742:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431452800 00000100:00100000:2.0:1787893054.577786:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431452800 00000100:00100000:2.0:1787893054.577863:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 50 00000100:00100000:2.0:1787893054.577875:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713044a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+20:11528:x1874741431452800:12345-192.168.202.29@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787893054.578589:0:5851:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787893054.578689:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00010000:00010000:2.0:1787893054.578734:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4b325 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.578780:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4b325 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.578793:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4b325 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.578803:0:5851:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4b325 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.578810:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4b325 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.578816:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4b325 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893054.578836:0:5851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787893054.578936:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713044a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+22:11528:x1874741431452800:12345-192.168.202.29@tcp:35:lhsmtool_posix.0 Request processed in 1062us (1296us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1787893054.578945:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 50 00000020:00080000:2.0:1787893054.578949:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787893054.579297:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787893054.579304:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4b325 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.579312:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9f600 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:3.0:1787893054.579317:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4b325 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.579324:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4b325 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.579337:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff907105cff000) 00010000:00010000:3.0:1787893054.579340:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787893054.579345:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4b325 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.579350:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4b325 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.579366:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893054.579368:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893054.579369:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787893054.698582:0:12525:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787893054.698593:0:12525:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787893054.698653:0:12525:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787893054.698660:0:12525:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787893054.895618:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893054.895656:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431453056 00000100:00100000:3.0:1787893054.895680:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431453056 00000100:00100000:3.0:1787893054.895724:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 187 00000100:00100000:3.0:1787893054.895731:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070011b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+22:11538:x1874741431453056:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:3.0:1787893054.895779:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893054.895803:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4b32c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b18d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.896079:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4b333 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.896091:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4b333 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.896100:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4b333 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893054.896109:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1787893054.899491:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4b32c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b18d expref: 25 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.899522:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4b333 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b18d expref: 24 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893054.899533:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9071063d7000) 00010000:00010000:3.0:1787893054.899536:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787893054.899539:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907104f47200, rc 0) 00000100:00100000:3.0:1787893054.899630:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070011b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+24:11538:x1874741431453056:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 3897us (4021us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1787893054.899640:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 187 00000100:00100000:0.0:1787893054.906630:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893054.906693:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431453184 00000100:00100000:1.0:1787893054.906702:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431453184 00000100:00100000:1.0:1787893054.906783:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 188 00000100:00100000:1.0:1787893054.906795:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e5c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+24:11538:x1874741431453184:12345-192.168.202.29@tcp:34:lfs.0 00010000:00010000:1.0:1787893054.906865:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b341 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.906878:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b341 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.906887:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b341 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.906897:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4b348 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.906902:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4b348 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.906906:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4b348 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.907126:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b200/0x825e3f5022b4b34f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.907143:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b200/0x825e3f5022b4b34f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.907150:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b200/0x825e3f5022b4b34f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787893054.907190:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b200/0x825e3f5022b4b34f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.907213:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b341 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.907220:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b341 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.907226:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b341 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.907232:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153b600 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893054.907237:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b341 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.907253:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b341 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.907265:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9071063d7000) 00010000:00010000:1.0:1787893054.907268:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893054.907273:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b341 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.907278:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b341 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.907297:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4b348 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.907303:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4b348 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.907310:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4b348 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.907315:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153b000 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893054.907318:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4b348 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.907324:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4b348 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.907332:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff907105907200) 00010000:00010000:1.0:1787893054.907334:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893054.907337:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4b348 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.907342:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4b348 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.907353:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b200/0x825e3f5022b4b34f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.907357:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b200/0x825e3f5022b4b34f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.907361:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b200/0x825e3f5022b4b34f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.907369:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153b200 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893054.907371:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b200/0x825e3f5022b4b34f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.907375:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b200/0x825e3f5022b4b34f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.907380:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff907105907700) 00010000:00010000:1.0:1787893054.907381:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893054.907382:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b200/0x825e3f5022b4b34f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893054.907386:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b200/0x825e3f5022b4b34f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893054.907449:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e5c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+24:11538:x1874741431453184:12345-192.168.202.29@tcp:34:lfs.0 Request processed in 657us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893054.907455:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 188 00000100:00100000:0.0:1787893055.002742:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893055.003049:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431453440 00000100:00100000:3.0:1787893055.003061:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431453440 00000100:00100000:3.0:1787893055.003121:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 189 00000100:00100000:3.0:1787893055.003132:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e5c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+24:11541:x1874741431453440:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:3.0:1787893055.003153:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893055.003179:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4b356 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b194 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.003279:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4b35d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.003295:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4b35d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.003307:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4b35d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.003323:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4b364 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.003330:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4b364 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.003336:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4b364 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.003709:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4b36b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.003718:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4b36b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.003738:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4b36b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893055.003779:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1787893055.003884:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4b35d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.003892:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4b35d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.003899:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4b35d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.003905:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f47c00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893055.003908:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4b35d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.003915:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4b35d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.003927:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9071063d7000) 00010000:00010000:3.0:1787893055.003930:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893055.003934:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4b35d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.003940:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4b35d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.003951:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4b364 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.003957:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4b364 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.003968:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4b364 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.003973:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f47e00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893055.003976:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4b364 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.003982:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4b364 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.003988:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff907102b84200) 00010000:00010000:3.0:1787893055.003990:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893055.003992:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4b364 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.003998:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4b364 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.004032:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4b356 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b194 expref: 27 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.004044:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4b36b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b194 expref: 26 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.004051:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff907102b84b00) 00010000:00010000:3.0:1787893055.004054:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787893055.004056:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907104f46000, rc 0) 00000100:00100000:3.0:1787893055.004113:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e5c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+26:11541:x1874741431453440:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 984us (1384us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1787893055.004127:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 189 00000100:00100000:3.0:1787893055.020392:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893055.020618:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431453568 00000100:00100000:1.0:1787893055.020630:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431453568 00000100:00100000:1.0:1787893055.020700:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 190 00000100:00100000:1.0:1787893055.020712:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070011b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+26:11541:x1874741431453568:12345-192.168.202.29@tcp:54:lfs.0 00010000:00010000:1.0:1787893055.020823:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4b379 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.020840:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4b379 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.020851:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4b379 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.020893:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4b379 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.020900:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4b379 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.020906:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4b379 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.020913:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153b000 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893055.020917:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4b379 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.020924:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4b379 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.020937:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff907102b84b00) 00010000:00010000:1.0:1787893055.020940:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787893055.020945:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4b379 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.020951:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4b379 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893055.021028:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070011b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+26:11541:x1874741431453568:12345-192.168.202.29@tcp:54:lfs.0 Request processed in 318us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893055.021036:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 190 00000100:00100000:0.0:1787893055.027665:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893055.027719:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431453824 00000100:00100000:2.0:1787893055.027733:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431453824 00000100:00100000:2.0:1787893055.027824:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 51 00000100:00100000:2.0:1787893055.027836:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e5c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+26:11541:x1874741431453824:12345-192.168.202.29@tcp:35:lfs.0 00000100:00100000:2.0:1787893055.028092:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e5c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+27:11541:x1874741431453824:12345-192.168.202.29@tcp:35:lfs.0 Request processed in 258us (439us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1787893055.028101:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 51 00000100:00100000:3.0:1787893055.064589:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893055.064722:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431454080 00000100:00100000:2.0:1787893055.064798:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431454080 00000100:00100000:2.0:1787893055.064874:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 191 00000100:00100000:2.0:1787893055.064885:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070011b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+27:11075:x1874741431454080:12345-192.168.202.29@tcp:101:bash.0 00010000:00010000:2.0:1787893055.064912:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893055.064933:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fa00/0x825e3f5022b4b380 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b19b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.065039:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4b387 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.065053:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4b36b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b194 expref: 28 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.065062:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4b387 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.065102:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4b36b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b194 expref: 28 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.065117:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4b36b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b194 expref: 28 pid: 5849 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893055.065132:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e82a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1874741455564928:192.168.202.29@tcp:104: 00000100:00100000:2.0:1787893055.065235:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710706ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1787893055.072355:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893055.072824:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431454208 00000100:00100000:1.0:1787893055.072838:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431454208 00010000:00010000:1.0:1787893055.072891:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4b36b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b194 expref: 29 pid: 5849 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893055.072953:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 73 00000100:00100000:1.0:1787893055.072964:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070011b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4829748d-dde1-497a-9623-0e4326f0972c+29:2361:x1874741431454208:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893055.072983:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893055.072991:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4b36b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b194 expref: 29 pid: 5849 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.073005:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4b36b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b194 expref: 29 pid: 5849 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.073033:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff907102b84b00) 00010000:00010000:1.0:1787893055.073039:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4b387 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.073049:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4b387 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.073056:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4b387 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.073103:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4b36b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b194 expref: 29 pid: 5849 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893055.073122:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e82a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1874741455564928:192.168.202.29@tcp:104: 00010000:00010000:2.0:1787893055.073150:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4b387 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.073218:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893055.073305:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070011b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4829748d-dde1-497a-9623-0e4326f0972c+28:2361:x1874741431454208:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 341us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893055.073314:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 73 00010000:00010000:2.0:1787893055.073491:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4b387 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.073499:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4b387 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893055.073518:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1787893055.073681:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fa00/0x825e3f5022b4b380 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b19b expref: 29 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.073697:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4b387 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b19b expref: 28 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.073704:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff907102b84b00) 00010000:00010000:2.0:1787893055.073707:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787893055.073709:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9ec00, rc 0) 00000100:00100000:2.0:1787893055.073800:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070011b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+28:11075:x1874741431454080:12345-192.168.202.29@tcp:101:bash.0 Request processed in 8917us (9224us total) trans 4294967473 rc 0/0 00000100:00100000:2.0:1787893055.073808:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 191 00000100:00100000:3.0:1787893055.080172:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893055.080400:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431454464 00000100:00100000:1.0:1787893055.080411:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431454464 00000100:00100000:1.0:1787893055.080471:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 192 00000100:00100000:1.0:1787893055.080481:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070011b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+28:11075:x1874741431454464:12345-192.168.202.29@tcp:36:bash.0 00010000:00010000:1.0:1787893055.080848:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4b395 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.080869:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4b395 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.080901:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4b395 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787893055.080955:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000004:00010000:1.0:1787893055.080980:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000f99a022 reply state 00000000409c8b81 transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4b395 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893055.080988:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1787893055.081037:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000100:00100000:1.0:1787893055.081143:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070011b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+32:11075:x1874741431454464:12345-192.168.202.29@tcp:36:bash.0 Request processed in 663us (983us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1787893055.081151:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 192 00000020:00080000:1.0:1787893055.081156:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1787893055.087330:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4b395 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.087349:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4b395 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.087358:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4b395 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.087365:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153b000 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893055.087371:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4b395 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.087378:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4b395 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.087401:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff907102b84b00) 00010000:00010000:1.0:1787893055.087422:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893055.087427:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4b395 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.087434:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b000/0x825e3f5022b4b395 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893055.088032:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893055.091436:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431454592 00000100:00100000:1.0:1787893055.091453:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431454592 00000100:00100000:0.0:1787893055.091632:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 193 00000100:00100000:0.0:1787893055.091643:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070011b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+31:11075:x1874741431454592:12345-192.168.202.29@tcp:101:bash.0 00010000:00010000:0.0:1787893055.091673:0:8281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893055.091695:0:8281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4b39c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b1a2 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.091808:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4b39c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1a2 expref: 32 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.091823:0:8281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4b39c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1a2 expref: 32 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.091844:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff907102b84b00) 00010000:00010000:0.0:1787893055.091848:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787893055.091851:0:8281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907137fc8200, rc 0) 00000100:00100000:0.0:1787893055.091952:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070011b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+32:11075:x1874741431454592:12345-192.168.202.29@tcp:101:bash.0 Request processed in 310us (3924us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893055.091965:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 193 00000100:00100000:0.0:1787893055.098924:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893055.099024:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431454720 00000100:00100000:2.0:1787893055.099035:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431454720 00000100:00100000:2.0:1787893055.099100:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 58 00000100:00100000:2.0:1787893055.099110:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e5c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4829748d-dde1-497a-9623-0e4326f0972c+7:11075:x1874741431454720:12345-192.168.202.29@tcp:101:bash.0 00010000:00010000:2.0:1787893055.099128:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893055.099149:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036b645eb/0x825e3f5022b4b3a3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b1a9 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787893055.099188:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a91153c, atime: 0x6a91153b, ctime: 0x6a91153c, blocks: 0xb 00010000:00010000:2.0:1787893055.099227:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=382s v=(0 0) 00010000:00010000:2.0:1787893055.099232:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893055.099249:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036b645eb/0x825e3f5022b4b3a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1a9 expref: 8 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.099270:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000036b645eb/0x825e3f5022b4b3a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1a9 expref: 8 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.099283:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9fa00, rc 0) 00000100:00100000:2.0:1787893055.099361:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e5c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4829748d-dde1-497a-9623-0e4326f0972c+8:11075:x1874741431454720:12345-192.168.202.29@tcp:101:bash.0 Request processed in 251us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893055.099369:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 58 00000100:00100000:3.0:1787893055.102120:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893055.102233:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431454848 00000100:00100000:0.0:1787893055.102253:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431454848 00002000:00010000:0.0:1787893055.102306:0:6706:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1787893055.102312:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9070011b6680 with x1874741431454848 ext(0->18446744073709551615) 00002000:00010000:0.0:1787893055.102325:0:6706:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9070011b6680. 00000100:00100000:0.0:1787893055.102373:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 5 00000100:00100000:0.0:1787893055.102384:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070011b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4829748d-dde1-497a-9623-0e4326f0972c+8:2360:x1874741431454848:12345-192.168.202.29@tcp:10:bash.0 00002000:00010000:0.0:1787893055.103072:0:6706:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787893055.103077:0:6706:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787893052 -> 1787893054 00002000:00010000:0.0:1787893055.103079:0:6706:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1787893051 -> 1787893051 00002000:00010000:0.0:1787893055.103081:0:6706:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787893052 -> 1787893054 00002000:00010000:0.0:1787893055.103083:0:6706:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1787893055.103194:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070011b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4829748d-dde1-497a-9623-0e4326f0972c+9:2360:x1874741431454848:12345-192.168.202.29@tcp:10:bash.0 Request processed in 810us (1083us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1787893055.103216:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 5 00002000:00010000:0.0:1787893055.103220:0:6706:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1787893055.103223:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9070011b6680 with x1874741431454848 ext(0->18446744073709551615) 00002000:00010000:0.0:1787893055.103228:0:6706:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9070011b6680. 00000100:00100000:0.0:1787893055.177629:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787893055.177659:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e5c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455565056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787893055.177769:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893055.177874:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455565056 00000100:00100000:3.0:1787893055.177883:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455565056 00000100:00100000:3.0:1787893055.177941:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787893055.177952:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e5c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874741455565056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787893055.177986:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787893055.178020:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787893055.178031:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e5c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874741455565056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893055.178038:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787893055.178056:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e5c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455565056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787893055.211442:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893055.212380:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431454976 00000100:00100000:2.0:1787893055.212392:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431454976 00000100:00100000:2.0:1787893055.212472:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 194 00000100:00100000:2.0:1787893055.212483:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070011b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+32:11555:x1874741431454976:12345-192.168.202.29@tcp:34:lfs.0 00010000:00010000:2.0:1787893055.212984:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4b3aa lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.213005:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4b3aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.213018:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4b3aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.213057:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b3b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.213065:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b3b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.213072:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b3b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.213977:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b3b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.213990:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b3b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.213998:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b3b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787893055.214042:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b3b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.214054:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4b3aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.214061:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4b3aa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.214069:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4b3aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.214075:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9e400 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893055.214079:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4b3aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.214094:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4b3aa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.214107:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9071063d7000) 00010000:00010000:2.0:1787893055.214110:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893055.214115:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4b3aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.214121:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4b3aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.214147:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b3b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.214154:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b3b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.214160:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b3b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.214166:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9fc00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893055.214168:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b3b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.214174:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b3b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.214181:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff907105cff300) 00010000:00010000:2.0:1787893055.214184:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893055.214187:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b3b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.214202:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b3b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.214219:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b3b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.214226:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b3b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.214231:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b3b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.214236:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9fe00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893055.214248:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b3b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.214254:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b3b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.214262:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff907102b84b00) 00010000:00010000:2.0:1787893055.214264:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893055.214267:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b3b8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.214273:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b3b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893055.214370:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070011b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+32:11555:x1874741431454976:12345-192.168.202.29@tcp:34:lfs.0 Request processed in 1884us (2934us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893055.214380:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 194 00000100:00100000:2.0:1787893055.274563:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893055.275615:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431455232 00000100:00100000:0.0:1787893055.275629:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431455232 00000100:00100000:0.0:1787893055.275695:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 195 00000100:00100000:0.0:1787893055.275706:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107e82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+32:11558:x1874741431455232:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:0.0:1787893055.275728:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893055.275772:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9200/0x825e3f5022b4b3bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b1b0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.275888:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b3c6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.275905:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b3c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.275918:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b3c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.275933:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4b3cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.275940:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4b3cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.275946:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4b3cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.276305:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9c00/0x825e3f5022b4b3d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.276315:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9c00/0x825e3f5022b4b3d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.276322:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9c00/0x825e3f5022b4b3d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893055.276333:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787893055.276433:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b3c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.276441:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b3c6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.276454:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b3c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.276461:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc9a00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:0.0:1787893055.276466:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b3c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.276474:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b3c6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.276488:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9071063d7000) 00010000:00010000:0.0:1787893055.276492:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893055.276498:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b3c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.277280:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b3c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.277300:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4b3cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.277307:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4b3cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.277314:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4b3cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.277320:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc8000 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:0.0:1787893055.277324:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4b3cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.277342:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4b3cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.277352:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9071061f7200) 00010000:00010000:0.0:1787893055.277355:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893055.277357:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4b3cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.277361:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4b3cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.277406:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9200/0x825e3f5022b4b3bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1b0 expref: 35 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.277416:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9c00/0x825e3f5022b4b3d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1b0 expref: 34 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.277421:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff907102b84b00) 00010000:00010000:0.0:1787893055.277422:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787893055.277424:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907137fc9c00, rc 0) 00000100:00100000:0.0:1787893055.277493:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107e82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+34:11558:x1874741431455232:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 1787us (2940us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1787893055.277598:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 195 00000100:00100000:2.0:1787893055.282566:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893055.282649:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431455360 00000100:00100000:3.0:1787893055.282660:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431455360 00000100:00100000:3.0:1787893055.282724:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 196 00000100:00100000:3.0:1787893055.282744:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f90f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+34:11558:x1874741431455360:12345-192.168.202.29@tcp:54:lfs.0 00010000:00010000:3.0:1787893055.282830:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4b3e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.282869:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4b387 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b19b expref: 34 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.282879:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4b3e2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.282915:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4b387 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b19b expref: 34 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.282931:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4b387 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b19b expref: 34 pid: 5849 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893055.282946:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070011b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1874741455565184:192.168.202.29@tcp:104: 00000100:00100000:3.0:1787893055.283035:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff907139cde900 going to sleep for 11 seconds 00000100:00100000:1.0:1787893055.285960:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893055.286036:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431455616 00000100:00100000:2.0:1787893055.286045:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431455616 00000100:00100000:3.0:1787893055.286079:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070011b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1874741455565184:192.168.202.29@tcp:104: 00000100:00100000:2.0:1787893055.286107:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 52 00010000:00010000:3.0:1787893055.286110:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4b3e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893055.286117:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907003267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+35:5601:x1874741431455616:12345-192.168.202.29@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787893055.286626:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907003267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+36:5601:x1874741431455616:12345-192.168.202.29@tcp:35:ldlm_bl.0 Request processed in 508us (673us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1787893055.286634:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 52 00000100:00100000:3.0:1787893055.288875:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893055.290371:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431455744 00000100:00100000:1.0:1787893055.290385:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431455744 00010000:00010000:1.0:1787893055.290427:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4b387 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b19b expref: 36 pid: 5849 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893055.290467:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 74 00000100:00100000:1.0:1787893055.290477:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070011b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4829748d-dde1-497a-9623-0e4326f0972c+36:2361:x1874741431455744:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893055.290507:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893055.290516:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4b387 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b19b expref: 36 pid: 5849 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.290531:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4b387 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b19b expref: 36 pid: 5849 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.290557:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4b387 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b19b expref: 36 pid: 5849 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.290575:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff907102b84b00) 00010000:00010000:1.0:1787893055.290581:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4b3e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.290602:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4b3e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.290607:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4b3e2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.290630:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787893055.290658:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4b3e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.290666:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4b3e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893055.290693:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070011b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4829748d-dde1-497a-9623-0e4326f0972c+35:2361:x1874741431455744:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 218us (1829us total) trans 0 rc 0/0 00010000:00010000:3.0:1787893055.290698:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4b3e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893055.290700:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 74 00010000:00010000:3.0:1787893055.290717:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4b3e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.290724:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4b3e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.290729:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f47600 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893055.290744:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4b3e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.290782:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4b3e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.290792:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff907102b84b00) 00010000:00010000:3.0:1787893055.290795:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787893055.290798:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4b3e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.290804:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4b3e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893055.290852:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f90f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+34:11558:x1874741431455360:12345-192.168.202.29@tcp:54:lfs.0 Request processed in 8118us (8297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893055.290860:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 196 00000001:00080000:2.0:1787893055.291985:0:6725:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:2.0:1787893055.292008:0:6725:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000100:00100000:3.0:1787893055.293947:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893055.294300:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431456000 00000100:00100000:1.0:1787893055.294312:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431456000 00000100:00100000:1.0:1787893055.294376:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 53 00000100:00100000:1.0:1787893055.294386:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070011b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+34:11558:x1874741431456000:12345-192.168.202.29@tcp:35:lfs.0 00000100:00100000:1.0:1787893055.294687:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070011b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+35:11558:x1874741431456000:12345-192.168.202.29@tcp:35:lfs.0 Request processed in 301us (747us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1787893055.294696:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 53 00000100:00100000:1.0:1787893055.426879:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893055.427123:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431456256 00000100:00100000:0.0:1787893055.427134:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431456256 00000100:00100000:0.0:1787893055.427276:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 197 00000100:00100000:0.0:1787893055.427287:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907003267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+35:11569:x1874741431456256:12345-192.168.202.29@tcp:101:cat.0 00010000:00010000:0.0:1787893055.427334:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893055.427357:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9200/0x825e3f5022b4b3e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b1b7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.427427:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4b3f0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.427439:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4b3f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.427446:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4b3f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.427455:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b3f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.427460:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b3f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.427464:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b3f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.428402:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9400/0x825e3f5022b4b3fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.428414:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9400/0x825e3f5022b4b3fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.428421:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9400/0x825e3f5022b4b3fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893055.428429:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1787893055.428517:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4b3f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.428523:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4b3f0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.428528:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4b3f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.428532:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc8000 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:0.0:1787893055.428535:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4b3f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.428540:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4b3f0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.428549:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9071063d7000) 00010000:00010000:0.0:1787893055.428551:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893055.428555:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4b3f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.428559:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4b3f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.429637:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b3f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.429646:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b3f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.429651:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b3f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.429655:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc9a00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:0.0:1787893055.429669:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b3f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.429675:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b3f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.429685:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9071061f7300) 00010000:00010000:0.0:1787893055.429687:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893055.429690:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b3f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.429693:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b3f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.429749:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9200/0x825e3f5022b4b3e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1b7 expref: 38 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.429804:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9400/0x825e3f5022b4b3fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1b7 expref: 37 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.429812:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff907102b84b00) 00010000:00010000:0.0:1787893055.429815:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787893055.429818:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907137fc9400, rc 0) 00000100:00100000:0.0:1787893055.429897:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907003267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+37:11569:x1874741431456256:12345-192.168.202.29@tcp:101:cat.0 Request processed in 2611us (3029us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1787893055.429907:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 197 00000100:00100000:3.0:1787893055.434516:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893055.434657:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431456512 00000100:00100000:1.0:1787893055.434667:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431456512 00000100:00100000:1.0:1787893055.434733:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 54 00000100:00100000:1.0:1787893055.434744:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137e49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+37:11569:x1874741431456512:12345-192.168.202.29@tcp:35:cat.0 00000100:00100000:1.0:1787893055.435037:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137e49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+38:11569:x1874741431456512:12345-192.168.202.29@tcp:35:cat.0 Request processed in 294us (531us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1787893055.435044:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 54 00000100:00100000:3.0:1787893055.459472:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893055.459662:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431456768 00000100:00100000:2.0:1787893055.459676:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431456768 00000100:00100000:2.0:1787893055.459741:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 198 00000100:00100000:2.0:1787893055.459786:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712eb54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+38:11570:x1874741431456768:12345-192.168.202.29@tcp:36:rm.0 00010000:00010000:2.0:1787893055.460002:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787893055.460030:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9400/0x825e3f5022b4b3fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1b7 expref: 38 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.460054:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9c00/0x825e3f5022b4b3d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1b0 expref: 37 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.460066:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4b39c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1a2 expref: 36 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.460076:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff907102b84b00) 00010000:00010000:2.0:1787893055.460086:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787893055.460130:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b40c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.460145:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b40c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.460154:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b40c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.460168:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b413 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.460175:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b413 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.460182:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b413 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.460513:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4b41a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.460522:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4b41a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.460530:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4b41a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787893055.461590:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1787893055.461603:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 383228849906ns, next at 384228846764ns, rc = 0 00010000:00010000:2.0:1787893055.461668:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4b421 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.461680:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4b421 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.461697:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4b421 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.461706:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4b421 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.461712:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4b421 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.461718:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4b421 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.462065:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787893055.462090:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4b41a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.462097:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4b41a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.462103:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4b41a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.462109:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9e400 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893055.462113:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4b41a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.462358:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4b41a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.462372:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff907105cff000) 00010000:00010000:2.0:1787893055.462375:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787893055.462387:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4b41a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.462392:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4b41a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.462410:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b40c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.462416:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b40c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.462422:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b40c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.462426:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9fe00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893055.462429:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b40c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.462434:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b40c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.462441:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9071063d7000) 00010000:00010000:2.0:1787893055.462444:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893055.462446:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b40c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.462451:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b40c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787893055.462460:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d11b350a reply state 00000000ebf611dc transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b413 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893055.462479:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787893055.462585:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712eb54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+37:11570:x1874741431456768:12345-192.168.202.29@tcp:36:rm.0 Request processed in 2831us (3120us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1787893055.462594:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 198 00010000:00010000:3.0:1787893055.465030:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787893055.465047:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4b421 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.465082:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9f400 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:3.0:1787893055.465087:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4b421 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.465097:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4b421 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.465131:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff907105cff000) 00010000:00010000:3.0:1787893055.465135:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787893055.465141:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4b421 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.465146:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4b421 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.465171:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893055.465173:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893055.465175:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893055.465748:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b413 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.465775:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b413 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.465781:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b413 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.465786:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9fc00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893055.465791:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b413 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.465797:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b413 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.465807:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff907105cff300) 00010000:00010000:2.0:1787893055.465810:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893055.465825:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b413 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.465831:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b413 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893055.546846:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893055.547167:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431457024 00000100:00100000:2.0:1787893055.547178:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431457024 00000100:00100000:2.0:1787893055.547282:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 199 00000100:00100000:2.0:1787893055.547293:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907139e56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+36:11576:x1874741431457024:12345-192.168.202.29@tcp:101:bash.0 00010000:00010000:2.0:1787893055.547321:0:8281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893055.547342:0:8281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b428 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b1be expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.547479:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b42f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.547496:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b42f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.547508:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b42f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.547522:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4b436 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.547529:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4b436 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.547536:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4b436 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787893055.548652:0:8281:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1787893055.549487:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b43d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.549506:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b43d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.549520:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b43d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.549573:0:8281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b42f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.549581:0:8281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b42f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.549588:0:8281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b42f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.549595:0:8281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9fe00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893055.549600:0:8281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b42f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.549608:0:8281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b42f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.549622:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9071063d7000) 00010000:00010000:2.0:1787893055.549625:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893055.549630:0:8281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b42f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.549637:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b42f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787893055.549652:0:8281:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000045b301ec reply state 00000000469d8b91 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4b436 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893055.549661:0:8281:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787893055.549697:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b428 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1be expref: 39 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.549726:0:8281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b43d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1be expref: 38 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.549735:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff907105cff700) 00010000:00010000:2.0:1787893055.549738:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787893055.549740:0:8281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9e800, rc 0) 00000100:00100000:2.0:1787893055.551698:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907139e56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+39:11576:x1874741431457024:12345-192.168.202.29@tcp:101:bash.0 Request processed in 4391us (4848us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1787893055.551713:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 199 00010000:00010000:1.0:1787893055.561095:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893055.563748:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4b436 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.563804:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4b436 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.563818:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4b436 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.563825:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9e400 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893055.563831:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4b436 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.563838:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4b436 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.563856:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff907105cff300) 00010000:00010000:1.0:1787893055.563859:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893055.563866:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4b436 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.563873:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4b436 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893055.567456:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893055.567541:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431457152 00000100:00100000:1.0:1787893055.567551:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431457152 00000100:00100000:1.0:1787893055.567654:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 59 00000100:00100000:1.0:1787893055.567664:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907139e55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4829748d-dde1-497a-9623-0e4326f0972c+5:2360:x1874741431457152:12345-192.168.202.29@tcp:101:bash.0 00010000:00010000:1.0:1787893055.567684:0:6701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893055.567706:0:6701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000662e02ea/0x825e3f5022b4b44b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b1c5 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787893055.567792:0:6701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787893055.567825:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=383s v=(0 0) 00010000:00010000:1.0:1787893055.567830:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893055.567841:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000662e02ea/0x825e3f5022b4b44b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1c5 expref: 6 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.567860:0:6701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000662e02ea/0x825e3f5022b4b44b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1c5 expref: 6 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.567873:0:6701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90710153bc00, rc 0) 00000100:00100000:1.0:1787893055.567936:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907139e55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4829748d-dde1-497a-9623-0e4326f0972c+6:2360:x1874741431457152:12345-192.168.202.29@tcp:101:bash.0 Request processed in 273us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893055.567943:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 59 00000100:00100000:3.0:1787893055.574294:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893055.574453:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431457280 00000100:00100000:2.0:1787893055.574462:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431457280 00000100:00100000:2.0:1787893055.574533:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 60 00000100:00100000:2.0:1787893055.574544:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907139e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4829748d-dde1-497a-9623-0e4326f0972c+6:11576:x1874741431457280:12345-192.168.202.29@tcp:101:bash.0 00010000:00010000:2.0:1787893055.574563:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893055.574601:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001444a258/0x825e3f5022b4b452 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b1cc expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.574632:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000662e02ea/0x825e3f5022b4b44b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1c5 expref: 7 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.574641:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893055.574646:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893055.574651:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001444a258/0x825e3f5022b4b452 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1cc expref: 7 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.574704:0:6700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000662e02ea/0x825e3f5022b4b44b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1c5 expref: 7 pid: 6701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.574726:0:6700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000662e02ea/0x825e3f5022b4b44b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1c5 expref: 7 pid: 6701 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893055.574740:0:6700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f57f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6700:1874741455565312:192.168.202.29@tcp:104: 00000100:00100000:2.0:1787893055.575093:0:6700:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071081129c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787893055.588207:0:6700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f57f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6700:1874741455565312:192.168.202.29@tcp:104: 00010000:00010000:2.0:1787893055.588257:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001444a258/0x825e3f5022b4b452 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1cc expref: 7 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.588279:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9fc00, rc 0) 00000100:00100000:2.0:1787893055.588508:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907139e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4829748d-dde1-497a-9623-0e4326f0972c+7:11576:x1874741431457280:12345-192.168.202.29@tcp:101:bash.0 Request processed in 13965us (14223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893055.588518:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 60 00000100:00100000:0.0:1787893055.596705:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893055.597079:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431457408 00000100:00100000:3.0:1787893055.597090:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431457408 00010000:00010000:3.0:1787893055.597145:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000662e02ea/0x825e3f5022b4b44b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1c5 expref: 7 pid: 6701 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893055.597188:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 75 00000100:00100000:3.0:1787893055.597197:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107fa6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4829748d-dde1-497a-9623-0e4326f0972c+7:2360:x1874741431457408:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787893055.597231:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893055.597264:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000662e02ea/0x825e3f5022b4b44b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1c5 expref: 7 pid: 6701 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.597279:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000662e02ea/0x825e3f5022b4b44b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1c5 expref: 7 pid: 6701 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.597304:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000662e02ea/0x825e3f5022b4b44b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1c5 expref: 7 pid: 6701 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.597322:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893055.597327:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893055.597335:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001444a258/0x825e3f5022b4b452 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1cc expref: 6 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.597344:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001444a258/0x825e3f5022b4b452 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1cc expref: 6 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.597381:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001444a258/0x825e3f5022b4b452 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1cc expref: 6 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893055.597397:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907139e54380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5835:1874741455565440:192.168.202.29@tcp:105: 00000100:00100000:3.0:1787893055.597489:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff907139cde900 going to sleep for 11 seconds 00000100:00100000:2.0:1787893055.605561:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907139e54380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5835:1874741455565440:192.168.202.29@tcp:105: 00010000:00010000:2.0:1787893055.605592:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893055.605668:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107fa6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4829748d-dde1-497a-9623-0e4326f0972c+6:2360:x1874741431457408:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 8470us (8972us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893055.605683:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 75 00000100:00100000:1.0:1787893055.622000:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893055.622116:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431457664 00000100:00100000:2.0:1787893055.622143:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431457664 00000100:00100000:2.0:1787893055.622677:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 55 00000100:00100000:2.0:1787893055.622693:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907003264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+38:11576:x1874741431457664:12345-192.168.202.29@tcp:35:bash.0 00000100:00100000:2.0:1787893055.624036:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907003264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+39:11576:x1874741431457664:12345-192.168.202.29@tcp:35:bash.0 Request processed in 1339us (2040us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1787893055.624048:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 55 00000100:00100000:0.0:1787893055.809961:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893055.810116:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431457792 00000100:00100000:3.0:1787893055.810127:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431457792 00000100:00100000:3.0:1787893055.810188:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 200 00000100:00100000:3.0:1787893055.810221:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e5c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+39:11593:x1874741431457792:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:3.0:1787893055.810256:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893055.810280:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4b459 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b1d3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.810369:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4b460 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.810385:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4b460 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.810396:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4b460 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893055.810458:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1787893055.810462:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787893055.810486:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4b460 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.810512:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4b459 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1d3 expref: 41 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.810530:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4b460 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1d3 expref: 40 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.810541:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9071063d7000) 00010000:00010000:3.0:1787893055.810545:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787893055.810549:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907104f47600, rc 0) 00000100:00100000:3.0:1787893055.810622:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e5c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+40:11593:x1874741431457792:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 404us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893055.810639:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 200 00000100:00100000:3.0:1787893055.816567:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893055.816965:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431458048 00000100:00100000:0.0:1787893055.816976:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431458048 00000100:00100000:0.0:1787893055.817116:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 201 00000100:00100000:0.0:1787893055.817128:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907139e56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+40:11593:x1874741431458048:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:0.0:1787893055.817152:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893055.817176:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9000/0x825e3f5022b4b467 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b1da expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.817325:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8800/0x825e3f5022b4b46e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.817341:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8800/0x825e3f5022b4b46e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.817354:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8800/0x825e3f5022b4b46e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893055.817367:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787893055.817507:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9000/0x825e3f5022b4b467 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1da expref: 43 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.817529:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8800/0x825e3f5022b4b46e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1da expref: 42 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.817538:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff907105cff700) 00010000:00010000:0.0:1787893055.817540:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787893055.817544:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907137fc8800, rc 0) 00000100:00100000:0.0:1787893055.817605:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907139e56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+42:11593:x1874741431458048:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 479us (1048us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1787893055.817612:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 201 00000100:00100000:1.0:1787893055.824684:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893055.827217:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893055.827700:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431458432 00000100:00100000:1.0:1787893055.827711:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431458432 00000100:00100000:2.0:1787893055.828154:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431458304 00000100:00100000:2.0:1787893055.828159:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431458304 00000100:00100000:0.0:1787893055.828893:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 202 00000100:00100000:0.0:1787893055.828927:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907003266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+43:11593:x1874741431458304:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:0.0:1787893055.828958:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893055.828984:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4b47c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b1e1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.829095:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8600/0x825e3f5022b4b483 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.829109:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8600/0x825e3f5022b4b483 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.829121:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8600/0x825e3f5022b4b483 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893055.829135:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787893055.829429:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4b47c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1e1 expref: 46 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.829454:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8600/0x825e3f5022b4b483 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1e1 expref: 45 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893055.829464:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff907105cff700) 00010000:00010000:0.0:1787893055.829467:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787893055.829470:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907137fc8600, rc 0) 00000100:00100000:0.0:1787893055.829546:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907003266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+45:11593:x1874741431458304:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 622us (4874us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1787893055.829554:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 202 00000100:00100000:1.0:1787893055.830209:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 15 00000100:00100000:1.0:1787893055.830221:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907003266a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4829748d-dde1-497a-9623-0e4326f0972c+44:2361:x1874741431458432:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893055.830242:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893055.830260:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8800/0x825e3f5022b4b46e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1da expref: 44 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.830274:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff907105cff700) 00010000:00010000:1.0:1787893055.830290:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893055.830328:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907003266a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4829748d-dde1-497a-9623-0e4326f0972c+43:2361:x1874741431458432:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 110us (3121us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893055.830337:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 15 00000100:00100000:3.0:1787893055.839124:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893055.839279:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431458560 00000100:00100000:1.0:1787893055.839289:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431458560 00000100:00100000:1.0:1787893055.839367:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 61 00000100:00100000:1.0:1787893055.839378:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907110cfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4829748d-dde1-497a-9623-0e4326f0972c+6:2363:x1874741431458560:12345-192.168.202.29@tcp:1:lfs.0 00010000:00010000:1.0:1787893055.839425:0:6702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070e1b17d/0x825e3f5022b4b491 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.839444:0:6702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001444a258/0x825e3f5022b4b452 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1cc expref: 6 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.839452:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893055.839456:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787893055.839461:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070e1b17d/0x825e3f5022b4b491 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.839494:0:6702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001444a258/0x825e3f5022b4b452 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1cc expref: 6 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.839507:0:6702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001444a258/0x825e3f5022b4b452 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1cc expref: 6 pid: 6700 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893055.839519:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907003265180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6702:1874741455565568:192.168.202.29@tcp:104: 00000100:00100000:1.0:1787893055.839606:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set ffff90713f4da9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787893055.842888:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893055.842993:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431458688 00000100:00100000:2.0:1787893055.843004:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431458688 00002000:00100000:2.0:1787893055.843055:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff90712e5c0700 x1874741431458688/t0(0) o4->4829748d-dde1-497a-9623-0e4326f0972c@192.168.202.29@tcp:216/0 lens 504/0 e 0 to 0 dl 1787893066 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787893055.843066:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90712e5c0700 with x1874741431458688 ext(0->8) 00010000:00010000:2.0:1787893055.843075:0:6705:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000001444a258/0x825e3f5022b4b452 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1cc expref: 7 pid: 6700 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.843091:0:6705:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000001444a258/0x825e3f5022b4b452 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1cc expref: 7 pid: 6700 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787893055.843098:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90712e5c0700 00000100:00100000:2.0:1787893055.843133:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 3 00000100:00100000:2.0:1787893055.843143:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e5c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4829748d-dde1-497a-9623-0e4326f0972c+7:2360:x1874741431458688:12345-192.168.202.29@tcp:4:lfs.0 00000100:00100000:2.0:1787893055.843979:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e5c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4829748d-dde1-497a-9623-0e4326f0972c+9:2360:x1874741431458688:12345-192.168.202.29@tcp:4:lfs.0 Request processed in 831us (1096us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787893055.843990:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 3 00002000:00100000:2.0:1787893055.843999:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff90712e5c0700 x1874741431458688/t4294967308(0) o4->4829748d-dde1-497a-9623-0e4326f0972c@192.168.202.29@tcp:216/0 lens 504/448 e 0 to 0 dl 1787893066 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787893055.844020:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90712e5c0700 with x1874741431458688 ext(0->8) 00010000:00010000:2.0:1787893055.844032:0:6705:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000001444a258/0x825e3f5022b4b452 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1cc expref: 9 pid: 6700 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.844045:0:6705:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000001444a258/0x825e3f5022b4b452 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1cc expref: 9 pid: 6700 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787893055.844052:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff90712e5c0700 00000100:00100000:1.0:1787893055.844263:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907003265180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6702:1874741455565568:192.168.202.29@tcp:104: 00010000:00010000:1.0:1787893055.844287:0:6702:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000070e1b17d/0x825e3f5022b4b491 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893055.847725:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893055.848036:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431458816 00000100:00100000:3.0:1787893055.848047:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431458816 00010000:00010000:3.0:1787893055.848085:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001444a258/0x825e3f5022b4b452 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1cc expref: 9 pid: 6700 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893055.848176:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 76 00000100:00100000:3.0:1787893055.848187:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4829748d-dde1-497a-9623-0e4326f0972c+9:2361:x1874741431458816:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787893055.848216:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787893055.848245:0:5834:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787893055.848249:0:5834:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787893055 00002000:00010000:3.0:1787893055.848251:0:5834:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787893055 00002000:00010000:3.0:1787893055.848253:0:5834:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787893055 00010000:00010000:3.0:1787893055.848260:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001444a258/0x825e3f5022b4b452 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1cc expref: 9 pid: 6700 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.848275:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001444a258/0x825e3f5022b4b452 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1cc expref: 9 pid: 6700 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.848299:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001444a258/0x825e3f5022b4b452 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1cc expref: 9 pid: 6700 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.848319:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787893055.848323:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787893055.848338:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000070e1b17d/0x825e3f5022b4b491 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.848348:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070e1b17d/0x825e3f5022b4b491 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.848385:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893055.848448:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4829748d-dde1-497a-9623-0e4326f0972c+8:2361:x1874741431458816:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 263us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893055.848457:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 76 00010000:00010000:1.0:1787893055.849006:0:6702:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000070e1b17d/0x825e3f5022b4b491 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.849017:0:6702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070e1b17d/0x825e3f5022b4b491 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.849041:0:6702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070e1b17d/0x825e3f5022b4b491 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.849049:0:6702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070e1b17d/0x825e3f5022b4b491 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.849056:0:6702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070e1b17d/0x825e3f5022b4b491 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.849062:0:6702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153be00 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:1.0:1787893055.849067:0:6702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070e1b17d/0x825e3f5022b4b491 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.849074:0:6702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070e1b17d/0x825e3f5022b4b491 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.849101:0:6702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070e1b17d/0x825e3f5022b4b491 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.849108:0:6702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070e1b17d/0x825e3f5022b4b491 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893055.849179:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907110cfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4829748d-dde1-497a-9623-0e4326f0972c+7:2363:x1874741431458560:12345-192.168.202.29@tcp:1:lfs.0 Request processed in 9803us (10063us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893055.849186:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 61 00000100:00100000:0.0:1787893055.853594:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893055.853702:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431459072 00000100:00100000:1.0:1787893055.853716:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431459072 00000100:00100000:1.0:1787893055.857399:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 56 00000100:00100000:1.0:1787893055.857415:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713044ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+43:11593:x1874741431459072:12345-192.168.202.29@tcp:35:lfs.0 00000004:00010000:1.0:1787893055.857490:0:5851:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8600/0x825e3f5022b4b483 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1e1 expref: 43 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787893055.858028:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1787893055.858078:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:1.0:1787893055.859017:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:1.0:1787893055.859090:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4b498 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.859110:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b43d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1be expref: 47 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.859119:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4b498 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.859167:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b43d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1be expref: 47 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.859183:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b43d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1be expref: 47 pid: 8281 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893055.859334:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907003267800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5851:1874741455565696:192.168.202.29@tcp:104: 00000100:00100000:1.0:1787893055.859482:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff90713f4da9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787893055.862791:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893055.863158:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431459200 00000100:00100000:3.0:1787893055.863169:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431459200 00010000:00010000:3.0:1787893055.863217:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b43d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1be expref: 48 pid: 8281 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893055.863266:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 77 00000100:00100000:3.0:1787893055.863276:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4829748d-dde1-497a-9623-0e4326f0972c+48:2361:x1874741431459200:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787893055.863291:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893055.863298:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b43d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1be expref: 48 pid: 8281 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.863310:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b43d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1be expref: 48 pid: 8281 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.863332:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff907105cff700) 00010000:00010000:3.0:1787893055.863337:0:8463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4b498 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.863363:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4b498 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.863370:0:8463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4b498 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.863387:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893055.863444:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4829748d-dde1-497a-9623-0e4326f0972c+48:2361:x1874741431459200:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 169us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893055.863452:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 77 00010000:00010000:1.0:1787893055.864659:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e800/0x825e3f5022b4b43d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1be expref: 47 pid: 8281 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893055.864681:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907003267800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5851:1874741455565696:192.168.202.29@tcp:104: 00010000:00010000:1.0:1787893055.864706:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4b498 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.864716:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4b498 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893055.864723:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4b498 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787893055.865006:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:1.0:1787893055.865275:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1787893055.865384:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907003267800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5851:1874741455565824:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787893055.865438:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893055.865513:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff90713f4dacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787893055.865561:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455565824 00000100:00100000:3.0:1787893055.865569:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455565824 00000100:00100000:3.0:1787893055.865644:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787893055.865654:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907003265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5851:x1874741455565824:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787893055.865901:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907003265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5851:x1874741455565824:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 247us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893055.865909:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787893055.866292:0:5851:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:2.0:1787893055.866298:0:5851:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:2.0:1787893055.866315:0:5851:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90712eb55180, transno 4294967307 00000100:00100000:2.0:1787893055.866365:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907003267800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5851:1874741455565824:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787893055.866902:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:2.0:1787893055.866970:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f57f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5851:1874741455565952:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787893055.867013:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893055.867111:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff907113d1d240 going to sleep for 11 seconds 00000100:00100000:3.0:1787893055.867613:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455565952 00000100:00100000:3.0:1787893055.867622:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455565952 00000100:00100000:3.0:1787893055.867665:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787893055.867674:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5851:x1874741455565952:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787893055.868149:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5851:x1874741455565952:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 474us (1134us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787893055.868168:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787893055.868292:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f57f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5851:1874741455565952:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787893055.868352:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1787893055.868395:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4b498 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.868406:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4b498 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.868414:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4b498 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.868431:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153ba00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893055.868436:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4b498 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.868445:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4b498 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.868462:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff907105cff700) 00010000:00010000:2.0:1787893055.868464:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787893055.868469:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4b498 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.868475:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153ba00/0x825e3f5022b4b498 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787893055.868654:0:5851:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787893055.868924:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1787893055.868936:0:5851:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 383636183273ns, next at 384636181439ns, rc = 0 00000001:00080000:2.0:1787893055.868943:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:2.0:1787893055.868975:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff907105cff700) 00010000:00010000:2.0:1787893055.868978:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787893055.868988:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8600/0x825e3f5022b4b483 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1e1 expref: 51 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893055.869134:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713044ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+50:11593:x1874741431459072:12345-192.168.202.29@tcp:35:lfs.0 Request processed in 11722us (15555us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1787893055.869144:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 56 00000020:00080000:2.0:1787893055.869149:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787893055.874219:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893055.874637:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431459328 00000100:00100000:3.0:1787893055.874650:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431459328 00000100:00100000:3.0:1787893055.874942:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 203 00000100:00100000:3.0:1787893055.874954:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+50:11593:x1874741431459328:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:3.0:1787893055.874988:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893055.875019:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4b49f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b1e8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.875105:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4b49f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1e8 expref: 51 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.875121:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4b49f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1e8 expref: 51 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893055.875142:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff907102b84200) 00010000:00010000:3.0:1787893055.875145:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787893055.875149:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907104f47e00, rc 0) 00000100:00100000:3.0:1787893055.875280:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+51:11593:x1874741431459328:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 328us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893055.875288:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 203 00000100:00100000:1.0:1787893055.879019:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893055.879113:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431459584 00000100:00100000:2.0:1787893055.879124:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431459584 00000100:00100000:2.0:1787893055.879289:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 57 00000100:00100000:2.0:1787893055.879301:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907003265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+51:11593:x1874741431459584:12345-192.168.202.29@tcp:35:lfs.0 00000100:00100000:2.0:1787893055.879612:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907003265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+52:11593:x1874741431459584:12345-192.168.202.29@tcp:35:lfs.0 Request processed in 312us (601us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1787893055.879620:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 57 00000100:00100000:1.0:1787893055.974074:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893055.974180:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431459712 00000100:00100000:2.0:1787893055.974191:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431459712 00000100:00100000:2.0:1787893055.974283:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 204 00000100:00100000:2.0:1787893055.974294:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907003265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+52:11603:x1874741431459712:12345-192.168.202.29@tcp:34:lfs.0 00010000:00010000:2.0:1787893055.974371:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b4a6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.974389:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b4a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.974399:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b4a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.974412:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4b4ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.974419:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4b4ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.974424:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4b4ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.974520:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b4b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.974541:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b4b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.974548:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b4b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787893055.974596:0:8281:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b4b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.974608:0:8281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b4a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.974614:0:8281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b4a6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.974621:0:8281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b4a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.974627:0:8281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9f200 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893055.974632:0:8281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b4a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.974640:0:8281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b4a6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.974651:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9071063d7000) 00010000:00010000:2.0:1787893055.974655:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893055.974660:0:8281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b4a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.974666:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b4a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.974688:0:8281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4b4ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.974693:0:8281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4b4ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.974699:0:8281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4b4ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.974704:0:8281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9ea00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893055.974707:0:8281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4b4ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.974713:0:8281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4b4ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.974721:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff907105cff700) 00010000:00010000:2.0:1787893055.974724:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893055.974727:0:8281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4b4ad lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.974732:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4b4ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.974748:0:8281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b4b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.974823:0:8281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b4b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.974828:0:8281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b4b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.974839:0:8281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9ee00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893055.974842:0:8281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b4b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.974848:0:8281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b4b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.974856:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff907102b84200) 00010000:00010000:2.0:1787893055.974859:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893055.974861:0:8281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b4b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893055.974867:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b4b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893055.974931:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907003265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+52:11603:x1874741431459712:12345-192.168.202.29@tcp:34:lfs.0 Request processed in 638us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893055.974939:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 204 00000100:00100000:0.0:1787893056.017217:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893056.017419:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431459968 00000100:00100000:2.0:1787893056.017430:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431459968 00000100:00100000:2.0:1787893056.017504:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 205 00000100:00100000:2.0:1787893056.017516:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+52:11606:x1874741431459968:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:2.0:1787893056.017538:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893056.017562:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b4bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b1ef expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.017649:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4b4c2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.017684:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4b4c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.017695:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4b4c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.017711:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b4c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.017718:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b4c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.017724:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b4c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.017901:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4b4d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.017910:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4b4d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.017918:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4b4d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893056.017928:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787893056.018028:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4b4c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.018038:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4b4c2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.018045:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4b4c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.018057:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9ea00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893056.018062:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4b4c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.018070:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4b4c2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.018083:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9071063d7000) 00010000:00010000:2.0:1787893056.018086:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893056.018091:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4b4c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.018098:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4b4c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.018113:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b4c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.018119:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b4c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.018124:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b4c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.018130:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9f200 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893056.018132:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b4c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.018138:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b4c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.018156:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff907105cff700) 00010000:00010000:2.0:1787893056.018159:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893056.018162:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b4c9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.018168:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b4c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.018373:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b4bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1ef expref: 55 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.018388:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4b4d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1ef expref: 54 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.018395:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff907102b84200) 00010000:00010000:2.0:1787893056.018397:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787893056.018400:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9e200, rc 0) 00000100:00100000:2.0:1787893056.018569:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+54:11606:x1874741431459968:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 1054us (1375us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1787893056.018577:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 205 00000100:00080000:0.0:1787893056.019132:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787893056.022602:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893056.023226:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431460096 00000100:00100000:2.0:1787893056.023243:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431460096 00000100:00100000:2.0:1787893056.023308:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 206 00000100:00100000:2.0:1787893056.023319:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907003267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+54:11606:x1874741431460096:12345-192.168.202.29@tcp:54:lfs.0 00010000:00010000:2.0:1787893056.023401:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b4de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.023421:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b4de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.023451:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b4de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.023482:0:8281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b4de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.023490:0:8281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b4de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.023497:0:8281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b4de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.023504:0:8281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9ee00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893056.023509:0:8281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b4de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.023516:0:8281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b4de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.023529:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff907102b84200) 00010000:00010000:2.0:1787893056.023532:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787893056.023536:0:8281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b4de lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.023544:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b4de lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893056.023634:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907003267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+54:11606:x1874741431460096:12345-192.168.202.29@tcp:54:lfs.0 Request processed in 316us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893056.023642:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 206 00000100:00100000:1.0:1787893056.026526:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893056.026616:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431460352 00000100:00100000:2.0:1787893056.026646:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431460352 00000100:00100000:2.0:1787893056.026714:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 58 00000100:00100000:2.0:1787893056.026725:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907003264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+54:11606:x1874741431460352:12345-192.168.202.29@tcp:35:lfs.0 00000100:00100000:2.0:1787893056.027022:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907003264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+55:11606:x1874741431460352:12345-192.168.202.29@tcp:35:lfs.0 Request processed in 298us (506us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1787893056.027031:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 58 00000100:00100000:1.0:1787893056.128145:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893056.128480:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431460608 00000100:00100000:3.0:1787893056.128491:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431460608 00000100:00100000:3.0:1787893056.128558:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 207 00000100:00100000:3.0:1787893056.128568:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907003267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+55:11616:x1874741431460608:12345-192.168.202.29@tcp:101:bash.0 00010000:00010000:3.0:1787893056.128593:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893056.128596:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787893056.128622:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4b460 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1d3 expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.128644:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9071063d7000) 00010000:00010000:3.0:1787893056.128650:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787893056.128663:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4b4e5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b1f6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.128989:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4b4ec lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.129005:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4b4d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1ef expref: 55 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.129014:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4b4ec lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.129046:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4b4d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1ef expref: 55 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.129061:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4b4d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1ef expref: 55 pid: 5849 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893056.129074:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907139e56680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1874741455566080:192.168.202.29@tcp:104: 00000100:00100000:3.0:1787893056.129167:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff907139cde6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787893056.134397:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893056.134514:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431460736 00000100:00100000:2.0:1787893056.134526:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431460736 00010000:00010000:2.0:1787893056.134575:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4b4d0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1ef expref: 56 pid: 5849 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893056.134622:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 78 00000100:00100000:2.0:1787893056.134633:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4829748d-dde1-497a-9623-0e4326f0972c+56:2361:x1874741431460736:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787893056.134647:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893056.134655:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4b4d0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1ef expref: 56 pid: 5849 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.134668:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4b4d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1ef expref: 56 pid: 5849 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.134691:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff907102b84200) 00010000:00010000:2.0:1787893056.134697:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4b4ec lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.134707:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4b4ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.134714:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4b4ec lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.134783:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893056.134852:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4829748d-dde1-497a-9623-0e4326f0972c+56:2361:x1874741431460736:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 221us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893056.134860:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 78 00010000:00010000:3.0:1787893056.136379:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4b4d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1ef expref: 55 pid: 5849 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893056.136403:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907139e56680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1874741455566080:192.168.202.29@tcp:104: 00010000:00010000:3.0:1787893056.136425:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4b4ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.136434:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4b4ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.136458:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4b4ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893056.136481:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787893056.136720:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4b4e5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1f6 expref: 56 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.136979:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4b4ec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1f6 expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.136990:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff907102b84200) 00010000:00010000:3.0:1787893056.136994:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787893056.136997:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907104f46000, rc 0) 00000100:00100000:3.0:1787893056.137116:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907003267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+55:11616:x1874741431460608:12345-192.168.202.29@tcp:101:bash.0 Request processed in 8547us (8982us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1787893056.137124:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 207 00000100:00100000:0.0:1787893056.140606:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893056.140695:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431460992 00000100:00100000:2.0:1787893056.140706:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431460992 00000100:00100000:2.0:1787893056.141093:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 208 00000100:00100000:2.0:1787893056.141105:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+55:11616:x1874741431460992:12345-192.168.202.29@tcp:36:bash.0 00010000:00010000:2.0:1787893056.142052:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b4fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.142072:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b4fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.142085:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b4fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787893056.142138:0:8281:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:2.0:1787893056.142162:0:8281:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d39eef61 reply state 00000000898c0c42 transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b4fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893056.142170:0:8281:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787893056.142449:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+58:11616:x1874741431460992:12345-192.168.202.29@tcp:36:bash.0 Request processed in 1343us (1854us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1787893056.142457:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 208 00000020:00080000:2.0:1787893056.142462:0:8281:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787893056.145676:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b4fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.145717:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b4fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.145734:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b4fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.145740:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9f200 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893056.145745:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b4fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.145772:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b4fa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.145790:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff907102b84200) 00010000:00010000:2.0:1787893056.145793:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893056.145798:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b4fa lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.145804:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b4fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893056.147401:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893056.147473:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431461120 00000100:00100000:2.0:1787893056.147485:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431461120 00000100:00100000:2.0:1787893056.147547:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 209 00000100:00100000:2.0:1787893056.147556:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+57:11616:x1874741431461120:12345-192.168.202.29@tcp:101:bash.0 00010000:00010000:2.0:1787893056.147579:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893056.147599:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4b501 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b1fd expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.147681:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4b508 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.147710:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4b4ec lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1f6 expref: 58 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.147719:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4b508 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.147816:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4b4ec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1f6 expref: 58 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.147832:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4b4ec lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1f6 expref: 58 pid: 5847 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893056.147847:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137e49c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1874741455566208:192.168.202.29@tcp:104: 00000100:00100000:2.0:1787893056.147929:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff90713f5886c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787893056.152318:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893056.152462:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137e49c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1874741455566208:192.168.202.29@tcp:104: 00010000:00010000:2.0:1787893056.152495:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4b508 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893056.152670:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431461248 00000100:00100000:3.0:1787893056.152679:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431461248 00010000:00010000:3.0:1787893056.152718:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4b4ec lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1f6 expref: 59 pid: 5847 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893056.152790:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 79 00000100:00100000:3.0:1787893056.152801:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907003266300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4829748d-dde1-497a-9623-0e4326f0972c+59:2361:x1874741431461248:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787893056.152826:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893056.152833:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4b4ec lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1f6 expref: 59 pid: 5847 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.152861:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4b4ec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1f6 expref: 59 pid: 5847 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.152884:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4b4ec lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1f6 expref: 59 pid: 5847 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.152900:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff907102b84200) 00010000:00010000:3.0:1787893056.152906:0:8463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4b508 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.152914:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4b508 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.152922:0:8463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4b508 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.152942:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893056.152995:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907003266300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4829748d-dde1-497a-9623-0e4326f0972c+58:2361:x1874741431461248:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 196us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893056.153002:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 79 00010000:00010000:0.0:1787893056.154629:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4b508 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893056.154646:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4b508 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893056.154700:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787893056.154704:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787893056.155070:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4b508 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893056.155112:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4b501 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1fd expref: 58 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893056.155132:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4b508 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1fd expref: 57 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893056.155141:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff907102b84200) 00010000:00010000:0.0:1787893056.155143:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787893056.155147:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9e200, rc 0) 00000100:00100000:2.0:1787893056.155433:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+57:11616:x1874741431461120:12345-192.168.202.29@tcp:101:bash.0 Request processed in 7875us (8037us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893056.155443:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 209 00000100:00100000:1.0:1787893056.160405:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893056.160573:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431461504 00000100:00100000:2.0:1787893056.160584:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431461504 00000100:00100000:2.0:1787893056.160676:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 59 00000100:00100000:2.0:1787893056.160687:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907003265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+57:11616:x1874741431461504:12345-192.168.202.29@tcp:35:bash.0 00000100:00100000:2.0:1787893056.160960:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907003265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+58:11616:x1874741431461504:12345-192.168.202.29@tcp:35:bash.0 Request processed in 274us (563us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1787893056.160980:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 59 00000100:00100000:0.0:1787893056.201351:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874741455566592:0@lo:400:kworker.0 00000100:00100000:0.0:1787893056.201428:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893056.201524:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787893056.201531:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874741455566464:0@lo:400:kworker.0 00000100:00100000:0.0:1787893056.201555:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893056.201592:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455566592 00000100:00100000:0.0:1787893056.201602:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455566592 00000100:00100000:0.0:1787893056.201658:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455566464 00000100:00100000:0.0:1787893056.201662:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455566464 00000100:00100000:0.0:1787893056.201684:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787893056.201693:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874741455566592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893056.201748:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874741455566592:12345-0@lo:400:kworker.0 Request processed in 55us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893056.201781:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787893056.201799:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787893056.201805:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907113d11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874741455566464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893056.201834:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907113d11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874741455566464:12345-0@lo:400:kworker.0 Request processed in 30us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893056.201839:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:0.0:1787893056.201856:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787893056.201884:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874741455566464:0@lo:400:kworker.0 00000100:00100000:0.0:1787893056.201894:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874741455566592:0@lo:400:kworker.0 00000100:00100000:2.0:1787893056.202040:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f4bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22d910cf-711e-44e0-9acf-212404ada550:3306:1874741455566336:0@lo:400:kworker.0 00000100:00100000:2.0:1787893056.202077:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893056.202107:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455566848:0@lo:400:kworker.0 00000100:00100000:2.0:1787893056.202132:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893056.202150:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787893056.202155:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874741455566720:0@lo:400:kworker.0 00000100:00100000:2.0:1787893056.202177:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893056.202199:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455566720 00000100:00100000:2.0:1787893056.202202:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455566720 00000100:00100000:2.0:1787893056.202242:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787893056.202249:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f471180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874741455566720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893056.202285:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f471180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874741455566720:12345-0@lo:400:kworker.0 Request processed in 36us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893056.202290:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787893056.202316:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874741455566720:0@lo:400:kworker.0 00000100:00100000:3.0:1787893056.202558:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455566848 00000100:00100000:3.0:1787893056.202562:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455566848 00000100:00100000:3.0:1787893056.202601:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787893056.202608:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137e49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1874741455566848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893056.202648:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137e49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1874741455566848:12345-0@lo:400:kworker.0 Request processed in 40us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893056.202654:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787893056.202691:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455566848:0@lo:400:kworker.0 00000100:00100000:0.0:1787893056.203007:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455566336 00000100:00100000:0.0:1787893056.203011:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455566336 00000100:00100000:0.0:1787893056.203145:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1787893056.203154:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+19:3306:x1874741455566336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893056.203213:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+19:3306:x1874741455566336:12345-0@lo:400:kworker.0 Request processed in 61us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893056.203238:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1787893056.203304:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f4bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:22d910cf-711e-44e0-9acf-212404ada550:3306:1874741455566336:0@lo:400:kworker.0 00000100:00080000:3.0:1787893056.203344:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787893056.203349:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787893056.244635:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893056.244743:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431461632 00000100:00100000:2.0:1787893056.244793:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431461632 00000100:00100000:2.0:1787893056.244861:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 210 00000100:00100000:2.0:1787893056.244871:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907003264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+58:11622:x1874741431461632:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:2.0:1787893056.244898:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893056.244921:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b50f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b204 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.244998:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b516 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.245025:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b516 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.245039:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b516 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893056.245115:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1787893056.245120:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787893056.245147:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b516 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.245179:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b50f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b204 expref: 60 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.245366:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b516 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b204 expref: 59 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.245377:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9071063d7000) 00010000:00010000:2.0:1787893056.245380:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787893056.245384:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9ee00, rc 0) 00000100:00100000:2.0:1787893056.245495:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907003264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+59:11622:x1874741431461632:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 624us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893056.245503:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 210 00000100:00100000:0.0:1787893056.248217:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893056.248420:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431461760 00000100:00100000:3.0:1787893056.248434:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431461760 00000100:00100000:3.0:1787893056.248503:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 211 00000100:00100000:3.0:1787893056.248514:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907113d10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+59:11622:x1874741431461760:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:3.0:1787893056.248535:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893056.248559:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4b51d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b20b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.248632:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4b524 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.248649:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4b524 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.248661:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4b524 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.248679:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4b52b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.248685:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4b52b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.248692:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4b52b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.249071:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fde00/0x825e3f5022b4b532 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.249081:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fde00/0x825e3f5022b4b532 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.249088:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fde00/0x825e3f5022b4b532 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893056.249128:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787893056.249133:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787893056.249155:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fde00/0x825e3f5022b4b532 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.249167:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fde00/0x825e3f5022b4b532 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.249174:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4b524 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.249180:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4b524 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.249186:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4b524 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.249318:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f47c00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893056.249323:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4b524 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.249332:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4b524 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.249352:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9071063d7000) 00010000:00010000:3.0:1787893056.249355:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893056.249361:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4b524 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.249367:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4b524 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.249381:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4b52b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.249387:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4b52b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.249393:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4b52b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.249398:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f47600 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893056.249401:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4b52b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.249407:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4b52b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.249415:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff907102b84000) 00010000:00010000:3.0:1787893056.249417:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893056.249421:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4b52b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.249427:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4b52b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.249473:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4b51d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b20b expref: 61 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.249488:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fde00/0x825e3f5022b4b532 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b20b expref: 60 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.249495:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff907102b84200) 00010000:00010000:3.0:1787893056.249498:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787893056.249500:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071013fde00, rc 0) 00000100:00100000:3.0:1787893056.249930:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907113d10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+60:11622:x1874741431461760:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 1415us (1735us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893056.249938:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 211 00000100:00100000:1.0:1787893056.255094:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893056.255266:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893056.255582:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431462144 00000100:00100000:2.0:1787893056.255595:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431462144 00000100:00100000:2.0:1787893056.255668:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 16 00000100:00100000:2.0:1787893056.255681:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907003264380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4829748d-dde1-497a-9623-0e4326f0972c+60:2360:x1874741431462144:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787893056.255698:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893056.255747:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fde00/0x825e3f5022b4b532 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b20b expref: 60 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.255795:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff907102b84200) 00010000:00010000:2.0:1787893056.255800:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893056.255874:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907003264380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4829748d-dde1-497a-9623-0e4326f0972c+59:2360:x1874741431462144:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 195us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893056.255882:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 16 00000100:00100000:3.0:1787893056.256444:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431462016 00000100:00100000:3.0:1787893056.256451:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431462016 00000100:00100000:3.0:1787893056.256496:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 212 00000100:00100000:3.0:1787893056.256505:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907003265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+59:11622:x1874741431462016:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:3.0:1787893056.256522:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893056.256539:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fcc00/0x825e3f5022b4b539 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b212 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.256643:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fc800/0x825e3f5022b4b540 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.256658:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4b508 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1fd expref: 60 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.256666:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fc800/0x825e3f5022b4b540 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.256710:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4b508 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1fd expref: 60 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.256836:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4b508 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1fd expref: 60 pid: 5849 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893056.256854:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907139e56680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1874741455566976:192.168.202.29@tcp:104: 00000100:00100000:3.0:1787893056.256991:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff907139cde6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787893056.263748:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907139e56680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1874741455566976:192.168.202.29@tcp:104: 00010000:00010000:3.0:1787893056.264183:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fc800/0x825e3f5022b4b540 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893056.265166:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893056.265666:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431462272 00000100:00100000:3.0:1787893056.265678:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431462272 00010000:00010000:3.0:1787893056.265725:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4b508 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1fd expref: 61 pid: 5849 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893056.266040:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 80 00000100:00100000:3.0:1787893056.266053:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107fa6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4829748d-dde1-497a-9623-0e4326f0972c+61:2361:x1874741431462272:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787893056.266072:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893056.266079:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4b508 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1fd expref: 61 pid: 5849 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.266093:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4b508 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1fd expref: 61 pid: 5849 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.266135:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e200/0x825e3f5022b4b508 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1fd expref: 61 pid: 5849 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.266152:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff907102b84200) 00010000:00010000:3.0:1787893056.266157:0:8463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fc800/0x825e3f5022b4b540 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.266166:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fc800/0x825e3f5022b4b540 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.266174:0:8463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fc800/0x825e3f5022b4b540 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.266618:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893056.266696:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107fa6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4829748d-dde1-497a-9623-0e4326f0972c+60:2361:x1874741431462272:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 642us (1531us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893056.266704:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 80 00010000:00010000:0.0:1787893056.267215:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fc800/0x825e3f5022b4b540 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893056.267237:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fc800/0x825e3f5022b4b540 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893056.267269:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787893056.267445:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fcc00/0x825e3f5022b4b539 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b212 expref: 61 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893056.267465:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fc800/0x825e3f5022b4b540 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b212 expref: 60 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893056.267473:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff907102b84200) 00010000:00010000:0.0:1787893056.267476:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787893056.267479:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071013fc800, rc 0) 00000100:00100000:0.0:1787893056.267535:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907003265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+60:11622:x1874741431462016:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 11031us (12456us total) trans 4294967503 rc 0/0 00000100:00100000:0.0:1787893056.267543:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 212 00000100:00100000:1.0:1787893056.273672:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893056.274034:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431462528 00000100:00100000:2.0:1787893056.274046:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431462528 00000100:00100000:2.0:1787893056.274160:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 17 00000100:00100000:2.0:1787893056.274172:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907003266a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4829748d-dde1-497a-9623-0e4326f0972c+60:11622:x1874741431462528:12345-192.168.202.29@tcp:103:lfs.0 00010000:00010000:2.0:1787893056.274202:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893056.274427:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4b49f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1e8 expref: 60 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.274450:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff907102b84200) 00010000:00010000:2.0:1787893056.274456:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893056.274525:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907003266a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4829748d-dde1-497a-9623-0e4326f0972c+59:11622:x1874741431462528:12345-192.168.202.29@tcp:103:lfs.0 Request processed in 355us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893056.274532:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 17 00000100:00100000:1.0:1787893056.277279:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893056.277589:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431462656 00000100:00100000:2.0:1787893056.277604:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431462656 00000100:00100000:2.0:1787893056.277681:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 213 00000100:00100000:2.0:1787893056.277694:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907003266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+59:11622:x1874741431462656:12345-192.168.202.29@tcp:58:lfs.0 00010000:00010000:2.0:1787893056.278181:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b54e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.278225:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b54e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.278248:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b54e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787893056.281197:0:8281:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1787893056.281603:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907003266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+59:11622:x1874741431462656:12345-192.168.202.29@tcp:58:lfs.0 Request processed in 3905us (4330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893056.281616:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 213 00000100:00100000:1.0:1787893056.285825:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893056.286184:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431462784 00000100:00100000:2.0:1787893056.286194:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431462784 00000100:00100000:2.0:1787893056.286268:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 214 00000100:00100000:2.0:1787893056.286282:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907003264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+59:11622:x1874741431462784:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:2.0:1787893056.286458:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893056.286483:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b555 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b219 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.286644:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b54e lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.286659:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b555 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b219 expref: 60 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.286685:0:5849:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b54e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.286698:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b555 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b219 expref: 60 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.286906:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff907102b84200) 00010000:00010000:2.0:1787893056.286909:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787893056.286914:0:5849:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b555 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b219 expref: 60 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.286922:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9fc00, rc 0) 00000100:00100000:2.0:1787893056.287118:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907003264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+60:11622:x1874741431462784:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 839us (1393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893056.287127:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 214 00010000:00010000:3.0:1787893056.584952:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787893056.650442:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787893056.650455:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787893056.650498:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1787893056.650509:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787893056.650678:0:11693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f4d1500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1874741455567104:192.168.202.29@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787893056.651318:0:11693:0:(client.c:2715:ptlrpc_set_wait()) set ffff90713f4dae40 going to sleep for 11 seconds 00000100:00100000:1.0:1787893056.660009:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893056.660194:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431462912 00000100:00100000:3.0:1787893056.660217:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431462912 00000100:00100000:3.0:1787893056.660302:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 215 00000100:00100000:3.0:1787893056.660370:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+61:11623:x1874741431462912:12345-192.168.202.29@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787893056.660401:0:5848:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787893056.660538:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+61:11623:x1874741431462912:12345-192.168.202.29@tcp:53:lhsmtool_posix.0 Request processed in 171us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893056.660546:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 215 00000100:00100000:2.0:1787893056.660863:0:11693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f4d1500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1874741455567104:192.168.202.29@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787893056.680246:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893056.680720:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431463040 00000100:00100000:3.0:1787893056.680898:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431463040 00000100:00100000:3.0:1787893056.680975:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 216 00000100:00100000:3.0:1787893056.680986:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907113d13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+60:11623:x1874741431463040:12345-192.168.202.29@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787893056.681072:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fca00/0x825e3f5022b4b55c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.681092:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fca00/0x825e3f5022b4b55c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.681104:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fca00/0x825e3f5022b4b55c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.681122:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b563 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.681130:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b563 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.681137:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b563 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.681161:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fcc00/0x825e3f5022b4b56a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.681170:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fcc00/0x825e3f5022b4b56a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.681177:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fcc00/0x825e3f5022b4b56a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893056.681579:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787893056.681585:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787893056.681616:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fcc00/0x825e3f5022b4b56a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.681630:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fca00/0x825e3f5022b4b55c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.681636:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fca00/0x825e3f5022b4b55c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.681644:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fca00/0x825e3f5022b4b55c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.681651:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071013fca00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893056.681655:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fca00/0x825e3f5022b4b55c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.681663:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fca00/0x825e3f5022b4b55c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.681676:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9071061f7700) 00010000:00010000:3.0:1787893056.681679:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893056.681685:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fca00/0x825e3f5022b4b55c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.681691:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fca00/0x825e3f5022b4b55c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.681708:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b563 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.681714:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b563 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.681720:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b563 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.681732:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071013fd400 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893056.681736:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b563 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.681741:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b563 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.681749:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff907102b84000) 00010000:00010000:3.0:1787893056.681947:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893056.681951:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b563 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.681958:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b563 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.681976:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fcc00/0x825e3f5022b4b56a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.681982:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fcc00/0x825e3f5022b4b56a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.681988:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fcc00/0x825e3f5022b4b56a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.681994:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071013fcc00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893056.681997:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fcc00/0x825e3f5022b4b56a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.682003:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fcc00/0x825e3f5022b4b56a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.682023:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff907102b84200) 00010000:00010000:3.0:1787893056.682025:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893056.682029:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fcc00/0x825e3f5022b4b56a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.682035:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fcc00/0x825e3f5022b4b56a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893056.682131:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907113d13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+60:11623:x1874741431463040:12345-192.168.202.29@tcp:34:lhsmtool_posix.0 Request processed in 1143us (1904us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893056.682140:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 216 00000100:00100000:1.0:1787893056.686475:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893056.686704:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431463296 00000100:00100000:3.0:1787893056.686715:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431463296 00000100:00100000:3.0:1787893056.686916:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 217 00000100:00100000:3.0:1787893056.686927:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+60:11623:x1874741431463296:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787893056.686947:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893056.686966:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fde00/0x825e3f5022b4b571 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b220 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.687072:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4b578 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.687087:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4b578 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.687097:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4b578 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893056.687110:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787893056.687508:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4b578 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.687516:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4b578 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.687522:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4b578 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.687527:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f47e00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893056.687532:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4b578 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.687539:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4b578 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.687552:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff907102b84200) 00010000:00010000:3.0:1787893056.687555:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787893056.687559:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4b578 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.687564:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4b578 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.687606:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fde00/0x825e3f5022b4b571 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b220 expref: 62 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.687616:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9071061f7700) 00010000:00010000:3.0:1787893056.687618:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787893056.687622:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fde00/0x825e3f5022b4b571 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b220 expref: 62 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.687643:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071013fde00, rc 0) 00000100:00100000:3.0:1787893056.687904:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+61:11623:x1874741431463296:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 Request processed in 977us (1697us total) trans 4294967504 rc 301/301 00000100:00100000:3.0:1787893056.687912:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 217 00000100:00100000:1.0:1787893056.692442:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893056.695495:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431463424 00000100:00100000:2.0:1787893056.695516:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431463424 00000100:00100000:2.0:1787893056.695746:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 218 00000100:00100000:2.0:1787893056.695777:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+61:11623:x1874741431463424:12345-192.168.202.29@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787893056.695818:0:5849:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787893056.695949:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+61:11623:x1874741431463424:12345-192.168.202.29@tcp:53:lhsmtool_posix.0 Request processed in 175us (3519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893056.695957:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 218 00000100:00100000:1.0:1787893056.699919:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893056.700185:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431463680 00000100:00100000:0.0:1787893056.700208:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431463680 00000100:00100000:0.0:1787893056.700282:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 219 00000100:00100000:0.0:1787893056.700292:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907108386a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+61:11623:x1874741431463680:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787893056.700316:0:8281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893056.700335:0:8281:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787893056.700377:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4b516 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b204 expref: 61 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893056.700399:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9071063d7000) 00010000:00010000:0.0:1787893056.700404:0:8281:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787893056.700418:0:8281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4b586 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b227 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787893056.700943:0:8281:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:0.0:1787893056.701155:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b58d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893056.701168:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b58d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893056.701178:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b58d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893056.701245:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4b586 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b227 expref: 63 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893056.701264:0:8281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b58d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b227 expref: 62 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893056.701272:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9071061f7300) 00010000:00010000:0.0:1787893056.701276:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787893056.701278:0:8281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907137fc9a00, rc 0) 00000100:00100000:0.0:1787893056.701359:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907108386a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+62:11623:x1874741431463680:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 Request processed in 1066us (1449us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1787893056.701383:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 219 00000100:00100000:1.0:1787893056.706054:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893056.706131:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431463936 00000100:00100000:3.0:1787893056.706143:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431463936 00000100:00100000:3.0:1787893056.706272:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 220 00000100:00100000:3.0:1787893056.706288:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907108385f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+62:11623:x1874741431463936:12345-192.168.202.29@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787893056.706564:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893056.706593:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4b58d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b227 expref: 62 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.706614:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9071061f7300) 00010000:00010000:3.0:1787893056.706623:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787893056.706641:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4b59b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.706652:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4b59b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.706659:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4b59b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.706669:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4b5a2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xf092adef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.706673:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4b5a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf092adef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.706683:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4b5a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf092adef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.706778:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4b59b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.706785:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4b59b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.706792:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4b59b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.706797:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f47e00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893056.706802:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4b59b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.706810:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4b59b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.706832:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9071063d7000) 00010000:00010000:3.0:1787893056.706834:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893056.706838:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4b59b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.706845:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4b59b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.706855:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4b5a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf092adef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.706861:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4b5a2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf092adef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.706873:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4b5a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf092adef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.706878:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f46000 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893056.706880:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4b5a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf092adef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.706884:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4b5a2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf092adef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.706890:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xf092adef (ffff907102b84000) 00010000:00010000:3.0:1787893056.706891:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893056.706893:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4b5a2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xf092adef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.706896:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4b5a2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xf092adef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893056.707005:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907108385f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+61:11623:x1874741431463936:12345-192.168.202.29@tcp:36:lhsmtool_posix.0 Request processed in 723us (960us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787893056.707012:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 220 00000100:00100000:1.0:1787893056.711107:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893056.711293:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431464064 00000100:00100000:0.0:1787893056.711305:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431464064 00000100:00100000:3.0:1787893056.711438:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 221 00000100:00100000:3.0:1787893056.711450:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907108386d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+61:11623:x1874741431464064:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787893056.711473:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893056.711502:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4b5a9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b22e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.711547:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4b5b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.711570:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4b5b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.711581:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4b5b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.711683:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4b5a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b22e expref: 63 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.711703:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4b5b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b22e expref: 62 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.711713:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff907102b84300) 00010000:00010000:3.0:1787893056.711716:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787893056.711902:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907104f47c00, rc 0) 00000100:00100000:3.0:1787893056.712006:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907108386d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+62:11623:x1874741431464064:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 Request processed in 557us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893056.712013:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 221 00000100:00100000:2.0:1787893056.715015:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000004:00080000:1.0:1787893056.715015:0:8104:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 384482259788ns, next at 385482257071ns, rc = 0 00000100:00100000:2.0:1787893056.715050:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431464320 00000100:00100000:2.0:1787893056.715058:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431464320 00000100:00100000:2.0:1787893056.715120:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 222 00000100:00100000:2.0:1787893056.715130:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f471500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+62:11623:x1874741431464320:12345-192.168.202.29@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787893056.715240:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b5b7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.715277:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b5b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893056.715283:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907107e81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455567232:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787893056.715289:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b5b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893056.715333:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893056.715470:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455567232 00000100:00100000:3.0:1787893056.715474:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455567232 00000100:00100000:3.0:1787893056.715499:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787893056.715506:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907139e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874741455567232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787893056.715533:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000040:00080000:2.0:1787893056.715537:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000100:00100000:3.0:1787893056.715578:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907139e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874741455567232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893056.715595:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000004:00010000:2.0:1787893056.715633:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000932a0f7 reply state 0000000052a38a9a transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b5b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893056.715641:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907107e81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455567232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787893056.715643:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787893056.715731:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f471500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+64:11623:x1874741431464320:12345-192.168.202.29@tcp:36:lhsmtool_posix.0 Request processed in 602us (720us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1787893056.715738:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 222 00010000:00010000:0.0:1787893056.718009:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b5b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893056.718028:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b5b7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893056.718037:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b5b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893056.718045:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9fe00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:0.0:1787893056.718050:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b5b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893056.718059:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b5b7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893056.718078:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff907102b84300) 00010000:00010000:0.0:1787893056.718081:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787893056.718087:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b5b7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893056.718093:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fe00/0x825e3f5022b4b5b7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893056.718599:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893056.719020:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431464448 00000100:00100000:0.0:1787893056.719030:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431464448 00000100:00100000:0.0:1787893056.719084:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 223 00000100:00100000:0.0:1787893056.719094:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f473800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+63:11623:x1874741431464448:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787893056.719137:0:8281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893056.719158:0:8281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4b5be lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b235 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893056.719247:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4b5be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b235 expref: 64 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893056.719262:0:8281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4b5be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b235 expref: 64 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893056.719285:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff907102b84300) 00010000:00010000:0.0:1787893056.719287:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787893056.719290:0:8281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907137fc8200, rc 0) 00000100:00100000:0.0:1787893056.719844:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f473800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+64:11623:x1874741431464448:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 Request processed in 264us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893056.719852:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 223 00000100:00100000:0.0:1787893056.722471:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893056.722562:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431464576 00000100:00100000:3.0:1787893056.722574:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431464576 00000100:00100000:3.0:1787893056.722668:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 62 00000100:00100000:3.0:1787893056.722679:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4829748d-dde1-497a-9623-0e4326f0972c+9:2360:x1874741431464576:12345-192.168.202.29@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787893056.723107:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4829748d-dde1-497a-9623-0e4326f0972c+10:2360:x1874741431464576:12345-192.168.202.29@tcp:2:lhsmtool_posix.0 Request processed in 427us (643us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1787893056.723116:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 62 00000100:00080000:0.0:1787893056.723178:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787893056.725923:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893056.726045:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431464832 00000100:00100000:2.0:1787893056.726057:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431464832 00000100:00100000:2.0:1787893056.726113:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 60 00000100:00100000:2.0:1787893056.726124:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107e81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+64:11623:x1874741431464832:12345-192.168.202.29@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787893056.726594:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107e81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+65:11623:x1874741431464832:12345-192.168.202.29@tcp:35:lhsmtool_posix.0 Request processed in 471us (686us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1787893056.726602:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 60 00000100:00100000:1.0:1787893056.730619:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893056.731043:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431465088 00000100:00100000:2.0:1787893056.731054:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431465088 00000100:00100000:2.0:1787893056.731138:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 224 00000100:00100000:2.0:1787893056.731149:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907108389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+65:11623:x1874741431465088:12345-192.168.202.29@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787893056.731522:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907108389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+65:11623:x1874741431465088:12345-192.168.202.29@tcp:57:lhsmtool_posix.0 Request processed in 374us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893056.731531:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 224 00000100:00100000:0.0:1787893056.734991:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893056.735104:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431465216 00000100:00100000:2.0:1787893056.735119:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431465216 00000100:00100000:2.0:1787893056.735185:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 225 00000100:00100000:2.0:1787893056.735207:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+65:11623:x1874741431465216:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787893056.735237:0:8281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893056.735259:0:8281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4b5c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b23c expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.735338:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4b5cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.735364:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4b5cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.735377:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4b5cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893056.735411:0:8281:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787893056.735431:0:8281:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4b5cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.735468:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4b5c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b23c expref: 67 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.735511:0:8281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4b5cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b23c expref: 66 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.735521:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff907102b84300) 00010000:00010000:2.0:1787893056.735524:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787893056.735528:0:8281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9f400, rc 0) 00000100:00100000:2.0:1787893056.735600:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+66:11623:x1874741431465216:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 Request processed in 394us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893056.735607:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 225 00000100:00100000:2.0:1787893056.738713:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893056.738885:0:8105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431465344 00000100:00100000:3.0:1787893056.738894:0:8105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431465344 00000100:00100000:3.0:1787893056.738944:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 63 00000100:00100000:3.0:1787893056.738955:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f473b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4829748d-dde1-497a-9623-0e4326f0972c+10:2361:x1874741431465344:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787893056.738975:0:8105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893056.738996:0:8105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b92c1f8b/0x825e3f5022b4b5d3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b243 expref: -99 pid: 8105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787893056.739023:0:8105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a911540, blocks: 0x1 00010000:00010000:3.0:1787893056.739041:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=384s v=(0 0) 00010000:00010000:3.0:1787893056.739046:0:8105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893056.739055:0:8105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b92c1f8b/0x825e3f5022b4b5d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b243 expref: 11 pid: 8105 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.739069:0:8105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b92c1f8b/0x825e3f5022b4b5d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b243 expref: 11 pid: 8105 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.739081:0:8105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071013fde00, rc 0) 00000100:00100000:3.0:1787893056.739133:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f473b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4829748d-dde1-497a-9623-0e4326f0972c+11:2361:x1874741431465344:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 Request processed in 181us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893056.739151:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 63 00000100:00100000:1.0:1787893056.741685:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893056.741749:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431465600 00000100:00100000:3.0:1787893056.741822:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431465600 00000100:00100000:0.0:1787893056.741973:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 226 00000100:00100000:0.0:1787893056.741988:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907003898380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+66:11623:x1874741431465600:12345-192.168.202.29@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787893056.742116:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907003898380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+66:11623:x1874741431465600:12345-192.168.202.29@tcp:57:lhsmtool_posix.0 Request processed in 133us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893056.742123:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 226 00000100:00100000:3.0:1787893056.745585:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893056.745943:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431465728 00000100:00100000:1.0:1787893056.745955:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431465728 00000100:00100000:1.0:1787893056.746063:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 64 00000100:00100000:1.0:1787893056.746075:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907139e55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4829748d-dde1-497a-9623-0e4326f0972c+11:11623:x1874741431465728:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787893056.746098:0:6702:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893056.746122:0:6702:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b152b258/0x825e3f5022b4b5da lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b24a expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893056.746158:0:6702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b92c1f8b/0x825e3f5022b4b5d3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b243 expref: 12 pid: 8105 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893056.746166:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893056.746171:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893056.746176:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b152b258/0x825e3f5022b4b5da lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b24a expref: 12 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893056.746237:0:6702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b92c1f8b/0x825e3f5022b4b5d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b243 expref: 12 pid: 8105 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893056.746254:0:6702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b92c1f8b/0x825e3f5022b4b5d3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b243 expref: 12 pid: 8105 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893056.746282:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f90c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6702:1874741455567360:192.168.202.29@tcp:104: 00000100:00100000:1.0:1787893056.746436:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set ffff90713f4daf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787893056.749732:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893056.749868:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f90c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6702:1874741455567360:192.168.202.29@tcp:104: 00010000:00010000:3.0:1787893056.749904:0:6702:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b152b258/0x825e3f5022b4b5da lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b24a expref: 12 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.749926:0:6702:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90710153b000, rc 0) 00000100:00100000:3.0:1787893056.749986:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907139e55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4829748d-dde1-497a-9623-0e4326f0972c+12:11623:x1874741431465728:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 Request processed in 3913us (4414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893056.749995:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 64 00000100:00100000:2.0:1787893056.750935:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431465856 00000100:00100000:2.0:1787893056.750948:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431465856 00010000:00010000:2.0:1787893056.750996:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b92c1f8b/0x825e3f5022b4b5d3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b243 expref: 12 pid: 8105 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893056.751034:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 81 00000100:00100000:2.0:1787893056.751044:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f90e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4829748d-dde1-497a-9623-0e4326f0972c+12:2361:x1874741431465856:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787893056.751062:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893056.751090:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b92c1f8b/0x825e3f5022b4b5d3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b243 expref: 12 pid: 8105 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.751105:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b92c1f8b/0x825e3f5022b4b5d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b243 expref: 12 pid: 8105 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.751132:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b92c1f8b/0x825e3f5022b4b5d3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b243 expref: 12 pid: 8105 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.751170:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893056.751176:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893056.751186:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b152b258/0x825e3f5022b4b5da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b24a expref: 11 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.751198:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b152b258/0x825e3f5022b4b5da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b24a expref: 11 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.751251:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b152b258/0x825e3f5022b4b5da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b24a expref: 11 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893056.751268:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f472680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1874741455567488:192.168.202.29@tcp:105: 00000100:00100000:2.0:1787893056.751356:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff90713f5886c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787893056.754423:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f472680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1874741455567488:192.168.202.29@tcp:105: 00010000:00010000:2.0:1787893056.754456:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893056.754534:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f90e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4829748d-dde1-497a-9623-0e4326f0972c+11:2361:x1874741431465856:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 3490us (4825us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893056.754548:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 81 00000100:00100000:1.0:1787893056.755599:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893056.755684:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431465984 00000100:00100000:0.0:1787893056.755694:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431465984 00002000:00100000:0.0:1787893056.755803:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff90713f90c700 x1874741431465984/t0(0) o4->4829748d-dde1-497a-9623-0e4326f0972c@192.168.202.29@tcp:217/0 lens 504/0 e 0 to 0 dl 1787893067 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787893056.755813:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90713f90c700 with x1874741431465984 ext(0->12) 00002000:00010000:0.0:1787893056.755819:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90713f90c700 00000100:00100000:0.0:1787893056.755848:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 6 00000100:00100000:0.0:1787893056.755858:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f90c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4829748d-dde1-497a-9623-0e4326f0972c+11:2361:x1874741431465984:12345-192.168.202.29@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787893056.756320:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f90c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4829748d-dde1-497a-9623-0e4326f0972c+13:2361:x1874741431465984:12345-192.168.202.29@tcp:4:lhsmtool_posix.0 Request processed in 462us (726us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1787893056.756328:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 6 00002000:00100000:0.0:1787893056.756335:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff90713f90c700 x1874741431465984/t4294967320(0) o4->4829748d-dde1-497a-9623-0e4326f0972c@192.168.202.29@tcp:217/0 lens 504/448 e 0 to 0 dl 1787893067 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787893056.756344:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90713f90c700 with x1874741431465984 ext(0->12) 00002000:00010000:0.0:1787893056.756347:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90713f90c700 00000100:00100000:1.0:1787893056.764721:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893056.764777:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431466112 00000100:00100000:2.0:1787893056.764789:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431466112 00000100:00100000:2.0:1787893056.764864:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 227 00000100:00100000:2.0:1787893056.764874:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712eb55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+66:11623:x1874741431466112:12345-192.168.202.29@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787893056.908322:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:1.0:1787893056.908367:0:5870:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:1.0:1787893056.908429:0:5870:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90713f4da240 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1787893056.908434:0:5870:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff907106564800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90713f4dad80 00000020:00080000:1.0:1787893056.908438:0:5870:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff907106564f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff907137f7b800 00000001:00080000:1.0:1787893056.908457:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000004:00080000:1.0:1787893056.908486:0:5870:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1787893056.908498:0:5870:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff907108112b40 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1787893056.908501:0:5870:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90713f4adc00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff907111b69480 00000020:00080000:1.0:1787893056.908504:0:5870:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90713f4adb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9071075ac400 00000004:00080000:1.0:1787893056.908517:0:5870:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:1.0:1787893056.908553:0:5881:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1787893056.908800:0:5881:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1787893056.908925:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787893056.908948:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712eb56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455567616:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787893056.909057:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893056.909130:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455567616 00000100:00100000:1.0:1787893056.909138:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455567616 00000100:00100000:1.0:1787893056.909192:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787893056.909202:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712eb57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1874741455567616:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787893056.909251:0:6700:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:1.0:1787893056.909285:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a91153f, atime: 0x6a91153f, ctime: 0x6a91153f, blocks: 0x1 00010000:00010000:1.0:1787893056.909307:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004b6a95d/0x825e3f5022b4b5e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893056.909324:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=384s v=(0 0) 00010000:00010000:1.0:1787893056.909328:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893056.909335:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004b6a95d/0x825e3f5022b4b5e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893056.909353:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004b6a95d/0x825e3f5022b4b5e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893056.909364:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004b6a95d/0x825e3f5022b4b5e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893056.909371:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004b6a95d/0x825e3f5022b4b5e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893056.909389:0:6700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787893056.909962:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712eb57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1874741455567616:12345-0@lo:6:osp-syn-0-0.0 Request processed in 760us (903us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787893056.909972:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:1.0:1787893056.910002:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893056.910009:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004b6a95d/0x825e3f5022b4b5e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893056.910018:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153a200 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:1.0:1787893056.910023:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004b6a95d/0x825e3f5022b4b5e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893056.910038:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004b6a95d/0x825e3f5022b4b5e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893056.910057:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004b6a95d/0x825e3f5022b4b5e1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893056.910064:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004b6a95d/0x825e3f5022b4b5e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893056.910083:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893056.910085:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893056.910087:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787893056.910123:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90712eb56a00/2, rc 0, transno 4294967310 00000100:00100000:1.0:1787893056.910130:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712eb56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455567616:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787893056.910480:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787893056.910491:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907139e55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455567744:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787893056.910531:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893056.910570:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455567744 00000100:00100000:3.0:1787893056.910575:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455567744 00000100:00100000:3.0:1787893056.910608:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787893056.910616:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907139e54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1874741455567744:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787893056.910636:0:6701:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:3.0:1787893056.910653:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfbbea87/0x825e3f5022b4b5e8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.910669:0:6701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000036b645eb/0x825e3f5022b4b3a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1a9 expref: 12 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.910696:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1787893056.910700:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787893056.910704:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfbbea87/0x825e3f5022b4b5e8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.910735:0:6701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000036b645eb/0x825e3f5022b4b3a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1a9 expref: 12 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.910777:0:6701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000036b645eb/0x825e3f5022b4b3a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1a9 expref: 12 pid: 6700 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893056.910791:0:6701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f4bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6701:1874741455567872:192.168.202.29@tcp:104: 00000100:00100000:3.0:1787893056.910850:0:6701:0:(client.c:2715:ptlrpc_set_wait()) set ffff907139cde300 going to sleep for 11 seconds 00000100:00100000:2.0:1787893056.912971:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712eb55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+20:11623:x1874741431466112:12345-192.168.202.29@tcp:44:lhsmtool_posix.0 Request processed in 148084us (148247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893056.913003:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 227 00000100:00100000:1.0:1787893056.916049:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893056.917096:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431466240 00000100:00100000:2.0:1787893056.917110:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431466240 00010000:00010000:2.0:1787893056.917167:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000036b645eb/0x825e3f5022b4b3a3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1a9 expref: 13 pid: 6700 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893056.917243:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 82 00000100:00100000:2.0:1787893056.917255:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712eb57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4829748d-dde1-497a-9623-0e4326f0972c+13:2360:x1874741431466240:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787893056.917274:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893056.917281:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000036b645eb/0x825e3f5022b4b3a3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1a9 expref: 13 pid: 6700 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.917295:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000036b645eb/0x825e3f5022b4b3a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1a9 expref: 13 pid: 6700 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.917328:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787893056.917332:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787893056.917339:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dfbbea87/0x825e3f5022b4b5e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.917349:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfbbea87/0x825e3f5022b4b5e8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.917539:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893056.917599:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712eb57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4829748d-dde1-497a-9623-0e4326f0972c+13:2360:x1874741431466240:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 346us (1562us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893056.917625:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 82 00010000:00010000:3.0:1787893056.917924:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036b645eb/0x825e3f5022b4b3a3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b1a9 expref: 12 pid: 6700 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893056.917943:0:6701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f4bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6701:1874741455567872:192.168.202.29@tcp:104: 00010000:00010000:3.0:1787893056.917969:0:6701:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dfbbea87/0x825e3f5022b4b5e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.917981:0:6701:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dfbbea87/0x825e3f5022b4b5e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.917989:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfbbea87/0x825e3f5022b4b5e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.918006:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfbbea87/0x825e3f5022b4b5e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.918014:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dfbbea87/0x825e3f5022b4b5e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.918029:0:6701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787893056.918400:0:7644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893056.918409:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dfbbea87/0x825e3f5022b4b5e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893056.918418:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071013fcc00 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:1.0:1787893056.918423:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfbbea87/0x825e3f5022b4b5e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893056.918433:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfbbea87/0x825e3f5022b4b5e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893056.918460:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dfbbea87/0x825e3f5022b4b5e8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893056.918468:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfbbea87/0x825e3f5022b4b5e8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893056.918486:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893056.918488:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893056.918490:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893056.918583:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893056.918664:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431466368 00000100:00100000:1.0:1787893056.918671:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431466368 00000100:00100000:1.0:1787893056.918708:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 67 00000100:00100000:1.0:1787893056.918729:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712eb56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4829748d-dde1-497a-9623-0e4326f0972c+12:2360:x1874741431466368:12345-192.168.202.29@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787893056.921523:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907139e54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1874741455567744:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10899us (10984us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1787893056.921537:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:2.0:1787893056.923052:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff907139e55500/2, rc 0, transno 4294967321 00000100:00100000:2.0:1787893056.923082:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907139e55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455567744:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1787893056.962632:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:0.0:1787893056.963514:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000100:00100000:3.0:1787893056.963943:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712eb56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4829748d-dde1-497a-9623-0e4326f0972c+9:2360:x1874741431466368:12345-192.168.202.29@tcp:16:lhsmtool_posix.0 Request processed in 45219us (45353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893056.963958:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 67 00000100:00100000:1.0:1787893056.967583:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893056.967700:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431466624 00000100:00100000:2.0:1787893056.967712:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431466624 00000100:00100000:2.0:1787893056.967869:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 228 00000100:00100000:2.0:1787893056.967880:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+20:11623:x1874741431466624:12345-192.168.202.29@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787893056.967936:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893056.967966:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4b5cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b23c expref: 20 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.967989:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff907102b84300) 00010000:00010000:2.0:1787893056.967995:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787893056.968035:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4b5ef lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.968050:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4b5ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.968061:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4b5ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787893056.968696:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fc0fe827 reply state 0000000087719dcf transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4b5ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893056.968708:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787893056.969835:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+21:11623:x1874741431466624:12345-192.168.202.29@tcp:36:lhsmtool_posix.0 Request processed in 1947us (2256us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1787893056.969848:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 228 00000100:00100000:3.0:1787893056.974348:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893056.974864:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431466752 00000100:00100000:0.0:1787893056.974876:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431466752 00000100:00100000:0.0:1787893056.974951:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 68 00000100:00100000:0.0:1787893056.974964:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4829748d-dde1-497a-9623-0e4326f0972c+7:2360:x1874741431466752:12345-192.168.202.29@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787893056.975235:0:6702:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787893056.975240:0:6702:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787893055 00002000:00010000:0.0:1787893056.975243:0:6702:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787893055 00002000:00010000:0.0:1787893056.975245:0:6702:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787893056 -> 1787893055 00002000:00010000:0.0:1787893056.975248:0:6702:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787893056.975315:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4829748d-dde1-497a-9623-0e4326f0972c+8:2360:x1874741431466752:12345-192.168.202.29@tcp:2:lhsmtool_posix.0 Request processed in 352us (980us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1787893056.975337:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 68 00000100:00100000:3.0:1787893056.977667:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893056.977709:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431467008 00000100:00100000:3.0:1787893056.977728:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431467008 00000100:00100000:3.0:1787893056.977825:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 229 00000100:00100000:3.0:1787893056.977834:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+21:11623:x1874741431467008:12345-192.168.202.29@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787893056.977912:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b5f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.977950:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4b5b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b22e expref: 21 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.977959:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b5f6 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.977995:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4b5b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b22e expref: 21 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.978008:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4b5b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b22e expref: 21 pid: 5848 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893056.978024:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f4bd880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1874741455568000:192.168.202.29@tcp:104: 00000100:00100000:3.0:1787893056.978126:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff907139cde900 going to sleep for 11 seconds 00000100:00100000:3.0:1787893056.981019:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f4bd880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1874741455568000:192.168.202.29@tcp:104: 00010000:00010000:3.0:1787893056.981048:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b5f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.981217:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4b5ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.981258:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4b5ef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.981266:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4b5ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.981272:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9e400 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893056.981277:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4b5ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.981284:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4b5ef lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.981303:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff907102b84300) 00010000:00010000:2.0:1787893056.981306:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893056.981312:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4b5ef lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.981318:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e400/0x825e3f5022b4b5ef lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893056.983577:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893056.983683:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431467136 00000100:00100000:1.0:1787893056.983694:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431467136 00010000:00010000:1.0:1787893056.983749:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4b5b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b22e expref: 21 pid: 5848 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893056.983820:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 83 00000100:00100000:1.0:1787893056.983831:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4829748d-dde1-497a-9623-0e4326f0972c+21:2361:x1874741431467136:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893056.983845:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893056.983853:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4b5b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b22e expref: 21 pid: 5848 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893056.983884:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4b5b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b22e expref: 21 pid: 5848 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893056.983907:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4b5b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b22e expref: 21 pid: 5848 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893056.983923:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff907102b84300) 00010000:00010000:1.0:1787893056.983928:0:8463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b5f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893056.983936:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b5f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893056.983944:0:8463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b5f6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893056.983970:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893056.984030:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4829748d-dde1-497a-9623-0e4326f0972c+20:2361:x1874741431467136:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 200us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893056.984038:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 83 00010000:00010000:3.0:1787893056.984438:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b5f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.984448:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b5f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.984478:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b5f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.984497:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b5f6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.984504:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b5f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.984510:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071013fd400 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893056.984515:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b5f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.984522:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b5f6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.984533:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff907102b84300) 00010000:00010000:3.0:1787893056.984536:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787893056.984539:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b5f6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.984545:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b5f6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893056.984646:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4829748d-dde1-497a-9623-0e4326f0972c+19:11623:x1874741431467008:12345-192.168.202.29@tcp:55:lhsmtool_posix.0 Request processed in 6812us (6992us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787893056.984655:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 229 00000100:00100000:3.0:1787893056.990243:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893056.990402:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431467264 00000100:00100000:0.0:1787893056.990414:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431467264 00000100:00100000:0.0:1787893056.990484:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 69 00000100:00100000:0.0:1787893056.990496:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4829748d-dde1-497a-9623-0e4326f0972c+8:2360:x1874741431467264:12345-192.168.202.29@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787893056.990550:0:6701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb611826/0x825e3f5022b4b5fd lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893056.990574:0:6701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b152b258/0x825e3f5022b4b5da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b24a expref: 8 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893056.990583:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787893056.990587:0:6701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787893056.990591:0:6701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb611826/0x825e3f5022b4b5fd lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893056.990631:0:6701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b152b258/0x825e3f5022b4b5da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b24a expref: 8 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893056.990647:0:6701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b152b258/0x825e3f5022b4b5da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b24a expref: 8 pid: 6702 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893056.990665:0:6701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6701:1874741455568128:192.168.202.29@tcp:104: 00000100:00100000:0.0:1787893056.990800:0:6701:0:(client.c:2715:ptlrpc_set_wait()) set ffff90712c4cc0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787893056.995493:0:6701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6701:1874741455568128:192.168.202.29@tcp:104: 00010000:00010000:3.0:1787893056.995535:0:6701:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fb611826/0x825e3f5022b4b5fd lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893056.995628:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893056.996135:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431467392 00000100:00100000:2.0:1787893056.996144:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431467392 00010000:00010000:2.0:1787893056.996182:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b152b258/0x825e3f5022b4b5da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b24a expref: 9 pid: 6702 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893056.996448:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 84 00000100:00100000:2.0:1787893056.996461:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4829748d-dde1-497a-9623-0e4326f0972c+9:2360:x1874741431467392:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787893056.996478:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893056.996510:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b152b258/0x825e3f5022b4b5da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b24a expref: 9 pid: 6702 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.996524:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b152b258/0x825e3f5022b4b5da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b24a expref: 9 pid: 6702 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.996551:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b152b258/0x825e3f5022b4b5da lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b24a expref: 9 pid: 6702 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.996568:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787893056.996573:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787893056.996579:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb611826/0x825e3f5022b4b5fd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.996588:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb611826/0x825e3f5022b4b5fd lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893056.996619:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893056.996681:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4829748d-dde1-497a-9623-0e4326f0972c+8:2360:x1874741431467392:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 223us (1053us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893056.996689:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 84 00010000:00010000:3.0:1787893056.996769:0:6701:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fb611826/0x825e3f5022b4b5fd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.996779:0:6701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb611826/0x825e3f5022b4b5fd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.996803:0:6701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fb611826/0x825e3f5022b4b5fd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.996823:0:6701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb611826/0x825e3f5022b4b5fd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.996832:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb611826/0x825e3f5022b4b5fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.996839:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc9e00 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:3.0:1787893056.996843:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb611826/0x825e3f5022b4b5fd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.996851:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb611826/0x825e3f5022b4b5fd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.996862:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb611826/0x825e3f5022b4b5fd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893056.996881:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb611826/0x825e3f5022b4b5fd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893056.996924:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4829748d-dde1-497a-9623-0e4326f0972c+7:2360:x1874741431467264:12345-192.168.202.29@tcp:1:lhsmtool_posix.0 Request processed in 6431us (6701us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893056.996931:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 69 00000100:00100000:1.0:1787893057.000442:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893057.000591:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431467648 00000100:00100000:0.0:1787893057.000604:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431467648 00000100:00100000:0.0:1787893057.000667:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 230 00000100:00100000:0.0:1787893057.000677:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e5c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+19:11623:x1874741431467648:12345-192.168.202.29@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787893057.000798:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8800/0x825e3f5022b4b604 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893057.000817:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8800/0x825e3f5022b4b604 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893057.000829:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8800/0x825e3f5022b4b604 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893057.001044:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9000/0x825e3f5022b4b60b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893057.001056:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4b5be lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b235 expref: 20 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893057.001065:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9000/0x825e3f5022b4b60b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893057.001102:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4b5be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b235 expref: 20 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893057.001115:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4b5be lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b235 expref: 20 pid: 8281 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893057.001128:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d13b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1874741455568256:192.168.202.29@tcp:104: 00000100:00100000:0.0:1787893057.001203:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff90712c4cc000 going to sleep for 11 seconds 00000100:00100000:1.0:1787893057.005256:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d13b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1874741455568256:192.168.202.29@tcp:104: 00010000:00010000:1.0:1787893057.005293:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9000/0x825e3f5022b4b60b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893057.006745:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893057.007197:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431467776 00000100:00100000:3.0:1787893057.007216:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431467776 00010000:00010000:3.0:1787893057.007269:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4b5be lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b235 expref: 21 pid: 8281 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893057.007313:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 85 00000100:00100000:3.0:1787893057.007324:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e5c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4829748d-dde1-497a-9623-0e4326f0972c+21:2360:x1874741431467776:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787893057.007339:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893057.007346:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4b5be lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b235 expref: 21 pid: 8281 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.007505:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4b5be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b235 expref: 21 pid: 8281 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.007532:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8200/0x825e3f5022b4b5be lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b235 expref: 21 pid: 8281 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.007554:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff907102b84300) 00010000:00010000:3.0:1787893057.007560:0:8463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9000/0x825e3f5022b4b60b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.007584:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9000/0x825e3f5022b4b60b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.007591:0:8463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9000/0x825e3f5022b4b60b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.007621:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787893057.007744:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9000/0x825e3f5022b4b60b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893057.007785:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9000/0x825e3f5022b4b60b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893057.007937:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e5c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4829748d-dde1-497a-9623-0e4326f0972c+20:2360:x1874741431467776:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 614us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893057.007944:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 85 00000001:00080000:1.0:1787893057.008334:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1787893057.008808:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:1.0:1787893057.008865:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1787893057.008948:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f564700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5847:1874741455568384:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787893057.009003:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893057.009037:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff90713f4da480 going to sleep for 11 seconds 00000100:00100000:2.0:1787893057.009169:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455568384 00000100:00100000:2.0:1787893057.009176:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455568384 00000100:00100000:2.0:1787893057.009242:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787893057.009251:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f567b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5847:x1874741455568384:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787893057.009348:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f567b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5847:x1874741455568384:12345-0@lo:1000:mdt00_000.0 Request processed in 98us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893057.009377:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787893057.009727:0:5847:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:3.0:1787893057.009734:0:5847:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:3.0:1787893057.009781:0:5847:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff907139e55500 x1874741455567744/t4294967321(4294967321) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787893072 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893057.009794:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f564700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5847:1874741455568384:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1787893057.010546:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:3.0:1787893057.010627:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907003264700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5847:1874741455568512:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787893057.010672:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893057.010695:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff907139cde3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787893057.010846:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455568512 00000100:00100000:2.0:1787893057.010853:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455568512 00000100:00100000:2.0:1787893057.010895:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787893057.010904:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f535500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5847:x1874741455568512:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787893057.011085:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f535500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5847:x1874741455568512:12345-0@lo:1000:mdt00_000.0 Request processed in 182us (413us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1787893057.011093:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787893057.012069:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907003264700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5847:1874741455568512:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1787893057.012116:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9000/0x825e3f5022b4b60b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.012126:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9000/0x825e3f5022b4b60b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.012134:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9000/0x825e3f5022b4b60b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.012156:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc9000 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893057.012161:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9000/0x825e3f5022b4b60b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.012169:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9000/0x825e3f5022b4b60b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.012195:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff907102b84300) 00010000:00010000:3.0:1787893057.012198:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787893057.012202:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9000/0x825e3f5022b4b60b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.012214:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9000/0x825e3f5022b4b60b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.012266:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b54e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.012273:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b54e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.012279:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b54e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.012285:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9f200 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893057.012288:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b54e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.012294:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b54e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.012315:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff907102b84200) 00010000:00010000:3.0:1787893057.012317:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787893057.012325:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b555 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b219 expref: 23 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.012336:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b555 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b219 expref: 23 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.012346:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b555 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b219 expref: 23 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.012541:0:5847:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b555 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b219 expref: 23 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893057.012556:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f536d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1874741455568640:192.168.202.29@tcp:105: 00000100:00100000:3.0:1787893057.012631:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff907139cde3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787893057.019300:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893057.019476:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431467904 00000100:00100000:1.0:1787893057.019486:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431467904 00000100:00100000:1.0:1787893057.019551:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 61 00000100:00100000:1.0:1787893057.019562:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+24:11622:x1874741431467904:12345-192.168.202.29@tcp:49:lfs.0 00000100:00100000:1.0:1787893057.019703:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+24:11622:x1874741431467904:12345-192.168.202.29@tcp:49:lfs.0 Request processed in 141us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893057.019710:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 61 00000100:00100000:3.0:1787893057.022343:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f536d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1874741455568640:192.168.202.29@tcp:105: 00010000:00010000:3.0:1787893057.022385:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b54e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.022396:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f200/0x825e3f5022b4b54e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.022437:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b612 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.022452:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b612 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.022483:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b612 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.022495:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b612 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.022502:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b612 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.022509:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b612 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.022515:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071013fd400 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893057.022519:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b612 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.022526:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b612 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.022538:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff907102b84200) 00010000:00010000:3.0:1787893057.022541:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893057.022545:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b612 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.022550:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b612 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.022561:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8800/0x825e3f5022b4b604 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.022567:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8800/0x825e3f5022b4b604 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.022581:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8800/0x825e3f5022b4b604 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.022586:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc8800 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893057.022589:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8800/0x825e3f5022b4b604 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.022595:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8800/0x825e3f5022b4b604 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.022603:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff907102b84200) 00010000:00010000:3.0:1787893057.022606:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787893057.022609:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8800/0x825e3f5022b4b604 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.022614:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8800/0x825e3f5022b4b604 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893057.022900:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e5c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+23:11623:x1874741431467648:12345-192.168.202.29@tcp:57:lhsmtool_posix.0 Request processed in 22222us (22467us total) trans 4294967513 rc 0/0 00000100:00100000:3.0:1787893057.022910:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 230 00000020:00080000:3.0:1787893057.022917:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787893057.023191:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787893057.023197:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787893057.023233:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1787893057.023240:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787893057.026272:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893057.026372:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431468160 00000100:00100000:3.0:1787893057.026385:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431468160 00000100:00100000:3.0:1787893057.026449:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 231 00000100:00100000:3.0:1787893057.026460:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+23:11622:x1874741431468160:12345-192.168.202.29@tcp:58:lfs.0 00000040:00080000:3.0:1787893057.026917:0:8281:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1787893057.027005:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+23:11622:x1874741431468160:12345-192.168.202.29@tcp:58:lfs.0 Request processed in 545us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893057.027021:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 231 00000100:00100000:0.0:1787893057.032184:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893057.032310:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431468416 00000100:00100000:1.0:1787893057.032322:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431468416 00000100:00100000:1.0:1787893057.032398:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 62 00000100:00100000:1.0:1787893057.032409:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907130448450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+23:11623:x1874741431468416:12345-192.168.202.29@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787893057.033185:0:5851:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787893057.033305:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:1.0:1787893057.033353:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4b619 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893057.033370:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4b619 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893057.033393:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4b619 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893057.033402:0:5851:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4b619 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893057.033407:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4b619 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893057.033412:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4b619 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893057.033431:0:5851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787893057.033524:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907130448450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+25:11623:x1874741431468416:12345-192.168.202.29@tcp:35:lhsmtool_posix.0 Request processed in 1116us (1350us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1787893057.033532:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 62 00000020:00080000:1.0:1787893057.033537:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787893057.033825:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787893057.033832:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4b619 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.033840:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153be00 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:3.0:1787893057.033845:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4b619 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.033853:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4b619 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.033868:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff907105907700) 00010000:00010000:3.0:1787893057.033870:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787893057.033876:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4b619 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.033882:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153be00/0x825e3f5022b4b619 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.033901:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893057.033903:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893057.033905:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893057.092064:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893057.092157:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431468544 00000100:00100000:3.0:1787893057.092167:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431468544 00000100:00100000:3.0:1787893057.092252:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 232 00000100:00100000:3.0:1787893057.092265:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f565f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+25:11625:x1874741431468544:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:3.0:1787893057.092292:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893057.092314:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b620 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b251 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.092570:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fca00/0x825e3f5022b4b627 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.092585:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fca00/0x825e3f5022b4b627 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.092597:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fca00/0x825e3f5022b4b627 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.092614:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fcc00/0x825e3f5022b4b62e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.092622:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fcc00/0x825e3f5022b4b62e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.092629:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fcc00/0x825e3f5022b4b62e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.093050:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fde00/0x825e3f5022b4b635 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.093062:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fc800/0x825e3f5022b4b540 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b212 expref: 26 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.093070:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fde00/0x825e3f5022b4b635 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.093105:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fc800/0x825e3f5022b4b540 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b212 expref: 26 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.093133:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fc800/0x825e3f5022b4b540 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b212 expref: 26 pid: 5847 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893057.093148:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f536d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1874741455568768:192.168.202.29@tcp:104: 00000100:00100000:3.0:1787893057.093702:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071081120c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787893057.100990:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f536d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1874741455568768:192.168.202.29@tcp:104: 00010000:00010000:3.0:1787893057.101024:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fde00/0x825e3f5022b4b635 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893057.103064:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893057.103587:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431468800 00000100:00100000:2.0:1787893057.103597:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431468800 00000100:00100000:2.0:1787893057.103655:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 63 00000100:00100000:2.0:1787893057.103666:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f564e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+27:5601:x1874741431468800:12345-192.168.202.29@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787893057.103923:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f564e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+28:5601:x1874741431468800:12345-192.168.202.29@tcp:35:ldlm_bl.0 Request processed in 257us (866us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1787893057.103930:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 63 00000100:00100000:2.0:1787893057.108598:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893057.108678:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431468928 00000100:00100000:1.0:1787893057.108690:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431468928 00010000:00010000:1.0:1787893057.108745:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fc800/0x825e3f5022b4b540 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b212 expref: 28 pid: 5847 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893057.108829:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 86 00000100:00100000:1.0:1787893057.108841:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107fa7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4829748d-dde1-497a-9623-0e4326f0972c+28:2360:x1874741431468928:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893057.108858:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893057.108865:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fc800/0x825e3f5022b4b540 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b212 expref: 28 pid: 5847 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893057.108894:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fc800/0x825e3f5022b4b540 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b212 expref: 28 pid: 5847 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893057.108919:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fc800/0x825e3f5022b4b540 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b212 expref: 28 pid: 5847 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893057.108937:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff907102b84200) 00010000:00010000:1.0:1787893057.108943:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fde00/0x825e3f5022b4b635 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893057.108953:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fde00/0x825e3f5022b4b635 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893057.108961:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fde00/0x825e3f5022b4b635 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893057.108983:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787893057.109070:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fde00/0x825e3f5022b4b635 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.109078:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fde00/0x825e3f5022b4b635 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893057.109125:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787893057.109131:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787893057.109150:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fde00/0x825e3f5022b4b635 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.109163:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fde00/0x825e3f5022b4b635 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.109173:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fca00/0x825e3f5022b4b627 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.109179:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fca00/0x825e3f5022b4b627 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.109215:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fca00/0x825e3f5022b4b627 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.109229:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071013fca00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893057.109234:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fca00/0x825e3f5022b4b627 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.109243:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fca00/0x825e3f5022b4b627 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.109253:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9071063d7000) 00010000:00010000:3.0:1787893057.109256:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893057.109260:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fca00/0x825e3f5022b4b627 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.109267:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fca00/0x825e3f5022b4b627 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.109277:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fcc00/0x825e3f5022b4b62e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.109283:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fcc00/0x825e3f5022b4b62e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.109288:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fcc00/0x825e3f5022b4b62e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.109293:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071013fcc00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893057.109296:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fcc00/0x825e3f5022b4b62e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.109310:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fcc00/0x825e3f5022b4b62e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.109320:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff907102b84300) 00010000:00010000:3.0:1787893057.109322:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893057.109325:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fcc00/0x825e3f5022b4b62e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.109330:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fcc00/0x825e3f5022b4b62e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.109378:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b620 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b251 expref: 28 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.109392:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fde00/0x825e3f5022b4b635 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b251 expref: 27 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893057.109399:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff907102b84200) 00010000:00010000:3.0:1787893057.109401:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787893057.109404:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071013fde00, rc 0) 00000100:00100000:1.0:1787893057.110349:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107fa7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4829748d-dde1-497a-9623-0e4326f0972c+27:2360:x1874741431468928:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 1505us (1756us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893057.110370:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 86 00000100:00100000:3.0:1787893057.110469:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f565f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+26:11625:x1874741431468544:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 18206us (18416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893057.110476:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 232 00010000:00010000:1.0:1787893057.609107:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787893057.841520:0:12578:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787893057.841531:0:12578:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787893057.841577:0:12578:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787893057.841584:0:12578:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1787893058.071582:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787893058.071593:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787893058.071638:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787893058.071643:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787893058.073511:0:11693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c3b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1874741455568896:192.168.202.29@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787893058.073642:0:11693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071103b7240 going to sleep for 11 seconds 00000100:00100000:3.0:1787893058.077790:0:11693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c3b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1874741455568896:192.168.202.29@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787893058.083826:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893058.084025:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431469056 00000100:00100000:3.0:1787893058.084036:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431469056 00000100:00100000:3.0:1787893058.084111:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 233 00000100:00100000:3.0:1787893058.084122:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+26:11637:x1874741431469056:12345-192.168.202.29@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787893058.084193:0:8281:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787893058.084307:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+26:11637:x1874741431469056:12345-192.168.202.29@tcp:53:lhsmtool_posix.0 Request processed in 187us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893058.084316:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 233 00000100:00080000:0.0:1787893058.084824:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787893058.088576:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893058.088665:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431469312 00000100:00100000:1.0:1787893058.088678:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431469312 00000100:00100000:1.0:1787893058.088783:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 234 00000100:00100000:1.0:1787893058.088796:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+26:11637:x1874741431469312:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787893058.088818:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893058.088840:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b200/0x825e3f5022b4b63c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b258 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893058.088973:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b643 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893058.088987:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b643 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893058.088998:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b643 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893058.089009:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787893058.089144:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b200/0x825e3f5022b4b63c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b258 expref: 29 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893058.089163:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b643 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b258 expref: 28 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893058.089172:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff907102b84200) 00010000:00010000:1.0:1787893058.089175:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787893058.089191:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90710153b600, rc 0) 00000100:00100000:1.0:1787893058.089257:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+28:11637:x1874741431469312:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 Request processed in 463us (692us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1787893058.089264:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 234 00000100:00100000:3.0:1787893058.093334:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893058.093492:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431469440 00000100:00100000:1.0:1787893058.093507:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431469440 00000100:00100000:1.0:1787893058.093590:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 18 00000100:00100000:1.0:1787893058.093604:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f536d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4829748d-dde1-497a-9623-0e4326f0972c+28:2360:x1874741431469440:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893058.093623:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893058.093668:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153b600/0x825e3f5022b4b643 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b258 expref: 28 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893058.093691:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff907102b84200) 00010000:00010000:1.0:1787893058.093696:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893058.093788:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f536d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4829748d-dde1-497a-9623-0e4326f0972c+27:2360:x1874741431469440:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 188us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893058.093796:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 18 00000100:00100000:1.0:1787893058.104426:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893058.104563:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431469696 00000100:00100000:3.0:1787893058.104578:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431469696 00000100:00100000:3.0:1787893058.104653:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 235 00000100:00100000:3.0:1787893058.104664:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f566300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+27:11637:x1874741431469696:12345-192.168.202.29@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787893058.104796:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b651 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893058.104826:0:8281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b651 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893058.104838:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b651 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893058.105061:0:8281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b651 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893058.105070:0:8281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b651 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893058.105077:0:8281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b651 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893058.105083:0:8281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071013fd400 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893058.105088:0:8281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b651 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893058.105118:0:8281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b651 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893058.105134:0:8281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff907102b84200) 00010000:00010000:3.0:1787893058.105138:0:8281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787893058.105143:0:8281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b651 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893058.105149:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b651 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893058.105335:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f566300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+28:11637:x1874741431469696:12345-192.168.202.29@tcp:57:lhsmtool_posix.0 Request processed in 670us (918us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1787893058.105530:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 235 00000040:00080000:3.0:1787893058.105662:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787893058.105666:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787893058.106686:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787893058.106702:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787893058.113126:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893058.113205:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431469952 00000100:00100000:1.0:1787893058.113225:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431469952 00000100:00100000:1.0:1787893058.113291:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 64 00000100:00100000:1.0:1787893058.113300:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+28:11637:x1874741431469952:12345-192.168.202.29@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787893058.113549:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+29:11637:x1874741431469952:12345-192.168.202.29@tcp:35:lhsmtool_posix.0 Request processed in 249us (431us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1787893058.113558:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 64 00010000:00010000:1.0:1787893058.636535:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893059.123424:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893059.123472:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893059.123518:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893059.123544:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893059.123570:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893059.123598:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431470080 00000100:00100000:1.0:1787893059.123609:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431470080 00000100:00100000:1.0:1787893059.123666:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 298 00000100:00100000:1.0:1787893059.123677:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+13:2362:x1874741431470080:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1787893059.123782:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:18703558-96be-475d-879f-15397926f758+13:2362:x1874741431470080:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 106us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893059.123805:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 298 00000100:00100000:1.0:1787893059.123841:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431470208 00000100:00100000:1.0:1787893059.123845:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431470208 00000100:00100000:1.0:1787893059.123882:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431470592 00000100:00100000:1.0:1787893059.123885:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431470592 00000100:00100000:1.0:1787893059.123917:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 163 00000100:00100000:1.0:1787893059.123925:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f565c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+29:2362:x1874741431470208:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1787893059.123961:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f565c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+29:2362:x1874741431470208:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 37us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893059.123967:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 163 00000100:00100000:1.0:1787893059.123981:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 164 00000100:00100000:1.0:1787893059.123987:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f90e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db96701a-d972-4021-b77b-4d58b82fa12c+5:2362:x1874741431470592:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1787893059.124013:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f90e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db96701a-d972-4021-b77b-4d58b82fa12c+5:2362:x1874741431470592:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 26us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893059.124018:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 164 00000100:00080000:1.0:1787893059.124156:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787893059.124309:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431470464 00000100:00100000:2.0:1787893059.124315:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431470464 00000100:00100000:2.0:1787893059.124356:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431470336 00000100:00100000:2.0:1787893059.124367:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431470336 00000100:00100000:2.0:1787893059.124392:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 96 00000100:00100000:2.0:1787893059.124399:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f565880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4829748d-dde1-497a-9623-0e4326f0972c+7:2362:x1874741431470464:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1787893059.124436:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f565880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4829748d-dde1-497a-9623-0e4326f0972c+7:2362:x1874741431470464:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 38us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893059.124442:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 96 00000100:00100000:2.0:1787893059.124454:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 97 00000100:00100000:2.0:1787893059.124461:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f564700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4829748d-dde1-497a-9623-0e4326f0972c+7:2362:x1874741431470336:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1787893059.124483:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f564700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4829748d-dde1-497a-9623-0e4326f0972c+7:2362:x1874741431470336:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 24us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893059.124488:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 97 00000100:00080000:1.0:1787893059.125028:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787893059.125033:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787893059.657889:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787893060.008444:0:12630:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787893060.008455:0:12630:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787893060.008503:0:12630:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787893060.008510:0:12630:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787893060.309211:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455569024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787893060.309281:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893060.310009:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455569024 00000100:00100000:0.0:1787893060.310019:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455569024 00000100:00100000:0.0:1787893060.310084:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787893060.310095:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874741455569024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787893060.310131:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787893060.310182:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874741455569024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893060.310190:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787893060.310262:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455569024:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787893060.310434:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787893060.331533:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893060.331571:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431470848 00000100:00100000:1.0:1787893060.331581:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431470848 00000100:00100000:1.0:1787893060.331650:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 236 00000100:00100000:1.0:1787893060.331661:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712eb57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+29:11657:x1874741431470848:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:1.0:1787893060.331703:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893060.331723:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4b658 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b25f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893060.331874:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4b65f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893060.331889:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4b65f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893060.331904:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4b65f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893060.331916:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787893060.333219:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153a000/0x825e3f5022b4b658 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b25f expref: 32 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893060.333245:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4b65f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b25f expref: 31 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893060.333255:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff907102b84200) 00010000:00010000:1.0:1787893060.333259:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787893060.333262:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90710153bc00, rc 0) 00000100:00100000:1.0:1787893060.334126:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712eb57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+31:11657:x1874741431470848:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 2460us (2595us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1787893060.334137:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 236 00000100:00080000:1.0:1787893060.334183:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787893060.341506:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893060.341545:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431470976 00000100:00100000:3.0:1787893060.341557:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431470976 00000100:00100000:3.0:1787893060.341611:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 237 00000100:00100000:3.0:1787893060.341623:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f536300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+31:11657:x1874741431470976:12345-192.168.202.29@tcp:54:lfs.0 00010000:00010000:3.0:1787893060.341697:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b66d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893060.341715:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b66d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893060.341741:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b66d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893060.341789:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b66d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893060.341796:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b66d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893060.341803:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b66d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893060.341809:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071013fd400 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893060.341814:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b66d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893060.341821:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b66d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893060.341835:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff907102b84200) 00010000:00010000:3.0:1787893060.341838:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787893060.341843:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b66d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893060.341849:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fd400/0x825e3f5022b4b66d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893060.341928:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f536300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4829748d-dde1-497a-9623-0e4326f0972c+31:11657:x1874741431470976:12345-192.168.202.29@tcp:54:lfs.0 Request processed in 308us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893060.341936:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 237 00000001:00080000:2.0:1787893060.377668:0:6725:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:2.0:1787893060.377693:0:6725:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:3.0:1787893060.519873:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893060.521104:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431471104 00000100:00100000:2.0:1787893060.521118:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431471104 00000100:00100000:2.0:1787893060.521203:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 70 00000100:00100000:2.0:1787893060.521214:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f537b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4829748d-dde1-497a-9623-0e4326f0972c+7:2361:x1874741431471104:12345-192.168.202.29@tcp:101:cat.0 00010000:00010000:2.0:1787893060.521246:0:6702:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893060.521274:0:6702:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054fb3861/0x825e3f5022b4b674 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b266 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787893060.521306:0:6702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a91153f, atime: 0x6a91153f, ctime: 0x6a91153f, blocks: 0xb 00010000:00010000:2.0:1787893060.521340:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=388s v=(0 0) 00010000:00010000:2.0:1787893060.521345:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893060.521356:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054fb3861/0x825e3f5022b4b674 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b266 expref: 8 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893060.521377:0:6702:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000054fb3861/0x825e3f5022b4b674 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b266 expref: 8 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893060.521392:0:6702:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9ea00, rc 0) 00000100:00100000:2.0:1787893060.521488:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f537b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4829748d-dde1-497a-9623-0e4326f0972c+8:2361:x1874741431471104:12345-192.168.202.29@tcp:101:cat.0 Request processed in 275us (1630us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893060.521495:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 70 00000100:00100000:1.0:1787893060.527792:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893060.528219:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431471232 00000100:00100000:2.0:1787893060.528233:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431471232 00002000:00100000:2.0:1787893060.528296:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff90713f4bd880 x1874741431471232/t0(0) o3->4829748d-dde1-497a-9623-0e4326f0972c@192.168.202.29@tcp:221/0 lens 488/0 e 0 to 0 dl 1787893071 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787893060.528307:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90713f4bd880 with x1874741431471232 ext(0->4095) 00002000:00010000:2.0:1787893060.528313:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90713f4bd880 00000100:00100000:2.0:1787893060.528354:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 7 00000100:00100000:2.0:1787893060.528364:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f4bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4829748d-dde1-497a-9623-0e4326f0972c+8:2360:x1874741431471232:12345-192.168.202.29@tcp:3:cat.0 00000100:00100000:2.0:1787893060.528586:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f4bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4829748d-dde1-497a-9623-0e4326f0972c+8:2360:x1874741431471232:12345-192.168.202.29@tcp:3:cat.0 Request processed in 222us (833us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787893060.528594:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 7 00002000:00100000:2.0:1787893060.528601:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff90713f4bd880 x1874741431471232/t0(0) o3->4829748d-dde1-497a-9623-0e4326f0972c@192.168.202.29@tcp:221/0 lens 488/4536 e 0 to 0 dl 1787893071 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787893060.528629:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff90713f4bd880 with x1874741431471232 ext(0->4095) 00002000:00010000:2.0:1787893060.528633:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff90713f4bd880 00010000:00010000:1.0:1787893060.682858:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893061.320973:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874741455569280:0@lo:400:kworker.0 00000100:00100000:0.0:1787893061.321041:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455569536:0@lo:400:kworker.0 00000100:00100000:1.0:1787893061.321066:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893061.321092:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893061.321162:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907105afaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455569792:0@lo:400:kworker.0 00000100:00100000:1.0:1787893061.321203:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893061.321231:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787893061.321237:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22d910cf-711e-44e0-9acf-212404ada550:3308:1874741455569152:0@lo:400:kworker.0 00000100:00100000:3.0:1787893061.321266:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712ebbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874741455569408:0@lo:400:kworker.0 00000100:00100000:1.0:1787893061.321270:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893061.321301:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907105af8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874741455569664:0@lo:400:kworker.0 00000100:00100000:3.0:1787893061.321308:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893061.321349:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455569280 00000100:00100000:1.0:1787893061.321358:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455569280 00000100:00100000:3.0:1787893061.321379:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455569536 00000100:00100000:3.0:1787893061.321386:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455569536 00000100:00100000:1.0:1787893061.321419:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455569408 00000100:00100000:1.0:1787893061.321424:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455569408 00000100:00100000:3.0:1787893061.321425:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455569792 00000100:00100000:3.0:1787893061.321430:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455569792 00000100:00100000:3.0:1787893061.321469:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787893061.321474:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787893061.321481:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105af8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455569536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893061.321486:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e5c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874741455569280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893061.321544:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105af8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455569536:12345-0@lo:400:kworker.0 Request processed in 65us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893061.321552:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e5c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874741455569280:12345-0@lo:400:kworker.0 Request processed in 68us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893061.321559:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787893061.321575:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787893061.321581:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787893061.321590:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907003266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1874741455569792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893061.321599:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787893061.321608:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f534a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874741455569408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893061.321625:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907003266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1874741455569792:12345-0@lo:400:kworker.0 Request processed in 36us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893061.321632:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787893061.321658:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f534a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874741455569408:12345-0@lo:400:kworker.0 Request processed in 51us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893061.321667:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:1.0:1787893061.321690:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787893061.321695:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787893061.321711:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874741455569408:0@lo:400:kworker.0 00000100:00100000:1.0:1787893061.321731:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455569152 00000100:00100000:1.0:1787893061.321737:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455569152 00000100:00100000:3.0:1787893061.321746:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893061.321795:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1787893061.321805:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907105afaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455569792:0@lo:400:kworker.0 00000100:00100000:1.0:1787893061.321806:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+19:3308:x1874741455569152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893061.321823:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874741455569280:0@lo:400:kworker.0 00000100:00100000:1.0:1787893061.321849:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22d910cf-711e-44e0-9acf-212404ada550+19:3308:x1874741455569152:12345-0@lo:400:kworker.0 Request processed in 46us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893061.321853:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712ebbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22d910cf-711e-44e0-9acf-212404ada550:3308:1874741455569152:0@lo:400:kworker.0 00000100:00100000:1.0:1787893061.321867:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1787893061.321873:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455569664 00000100:00100000:3.0:1787893061.321878:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455569664 00000100:00100000:3.0:1787893061.321920:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787893061.321928:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874741455569664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893061.321992:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874741455569664:12345-0@lo:400:kworker.0 Request processed in 54us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893061.321998:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:3.0:1787893061.322014:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787893061.322974:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907105af8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874741455569664:0@lo:400:kworker.0 00000100:00100000:0.0:1787893061.330965:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1787893061.330995:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:0.0:1787893061.331027:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90712eb56a00, transno 4294967310 00000100:00100000:0.0:1787893061.331063:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455569536:0@lo:400:kworker.0 00010000:00010000:1.0:1787893061.706051:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787893061.837670:0:8104:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 389604915005ns, next at 390604912715ns, rc = 0 00000100:00100000:0.0:1787893061.839310:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907003265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455569920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787893061.839391:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893061.839960:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455569920 00000100:00100000:3.0:1787893061.839971:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455569920 00000100:00100000:3.0:1787893061.840026:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787893061.840036:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105af9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1874741455569920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787893061.840073:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787893061.840122:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105af9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1874741455569920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893061.840130:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787893061.845520:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907003265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455569920:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1787893061.928391:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967509 is committed 00000001:00080000:1.0:1787893061.928411:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1787893061.928429:0:5870:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1787893061.928466:0:5870:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff907139cdec00 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1787893061.928480:0:5870:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90712ea65600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff907139cde900 00000020:00080000:1.0:1787893061.928483:0:5870:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90712ea65100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90713b6ce800 00000020:00080000:2.0:1787893061.928620:0:5881:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1787893061.929041:0:5881:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:0.0:1787893062.421634:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:0.0:1787893062.421659:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00010000:00010000:0.0:1787893062.735471:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893063.753899:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893064.250557:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893064.250613:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893064.250658:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893064.250682:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893064.250717:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893064.250733:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431471616 00000100:00100000:1.0:1787893064.250741:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431471872 00000100:00100000:1.0:1787893064.250748:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431471872 00000100:00100000:0.0:1787893064.250748:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431471616 00000100:00100000:2.0:1787893064.250857:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431471360 00000100:00100000:2.0:1787893064.250863:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431471360 00000100:00100000:2.0:1787893064.250922:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 300 00000100:00100000:2.0:1787893064.250933:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+13:2362:x1874741431471360:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1787893064.251028:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+13:2362:x1874741431471360:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 97us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893064.251037:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 300 00000100:00100000:1.0:1787893064.251369:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431471488 00000100:00100000:1.0:1787893064.251375:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431471488 00000100:00100000:0.0:1787893064.252288:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431471744 00000100:00100000:0.0:1787893064.252296:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431471744 00000100:00100000:1.0:1787893064.252302:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 168 00000100:00100000:1.0:1787893064.252312:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907003264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db96701a-d972-4021-b77b-4d58b82fa12c+5:2362:x1874741431471872:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1787893064.252322:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 100 00000100:00100000:0.0:1787893064.252329:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907003265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4829748d-dde1-497a-9623-0e4326f0972c+5:2362:x1874741431471616:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1787893064.252566:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907003264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db96701a-d972-4021-b77b-4d58b82fa12c+5:2362:x1874741431471872:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 254us (1906us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893064.252575:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 168 00000100:00100000:1.0:1787893064.252604:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 169 00000100:00100000:1.0:1787893064.252611:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907003265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+18:2362:x1874741431471488:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1787893064.259092:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907003265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4829748d-dde1-497a-9623-0e4326f0972c+5:2362:x1874741431471616:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 6741us (8455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893064.259114:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 100 00000100:00100000:1.0:1787893064.259117:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907003265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+18:2362:x1874741431471488:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 6503us (8429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893064.259128:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 169 00000100:00100000:0.0:1787893064.259180:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 101 00000100:00100000:0.0:1787893064.259198:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712eb56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4829748d-dde1-497a-9623-0e4326f0972c+7:2362:x1874741431471744:12345-192.168.202.29@tcp:400:kworker.0 00000100:00080000:1.0:1787893064.259268:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787893064.259271:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712eb56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4829748d-dde1-497a-9623-0e4326f0972c+7:2362:x1874741431471744:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 82us (8553us total) trans 0 rc 0/0 00000100:00080000:1.0:1787893064.259277:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787893064.259278:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 101 00000100:00080000:1.0:1787893064.259282:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787893064.777584:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893065.418996:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f472680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455570048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787893065.419094:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893065.421139:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455570048 00000100:00100000:3.0:1787893065.421175:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455570048 00000100:00100000:3.0:1787893065.421451:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787893065.421466:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f470380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455570048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787893065.421517:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787893065.421629:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f470380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455570048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 167us (2534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893065.421637:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1787893065.421945:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787893065.422015:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f472680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455570048:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787893065.802418:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893066.445475:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907105af8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22d910cf-711e-44e0-9acf-212404ada550:3307:1874741455570176:0@lo:400:kworker.0 00000100:00100000:0.0:1787893066.445564:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893066.445631:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907105af8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874741455570688:0@lo:400:kworker.0 00000100:00100000:0.0:1787893066.445661:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893066.445686:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787893066.445692:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907105afb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874741455570304:0@lo:400:kworker.0 00000100:00100000:0.0:1787893066.445713:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893066.445728:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907105afaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455570816:0@lo:400:kworker.0 00000100:00100000:0.0:1787893066.445773:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893066.445800:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907105afa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874741455570432:0@lo:400:kworker.0 00000100:00100000:0.0:1787893066.445823:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893066.445839:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787893066.445844:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907105afb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455570560:0@lo:400:kworker.0 00000100:00100000:0.0:1787893066.445864:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893066.445893:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455570816 00000100:00100000:0.0:1787893066.445901:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455570816 00000100:00100000:0.0:1787893066.445947:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455570560 00000100:00100000:0.0:1787893066.445950:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455570560 00000100:00100000:0.0:1787893066.445974:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787893066.445982:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455570816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893066.446032:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455570816:12345-0@lo:400:kworker.0 Request processed in 50us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893066.446039:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787893066.446058:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787893066.446065:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455570560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893066.446102:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455570560:12345-0@lo:400:kworker.0 Request processed in 38us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893066.446107:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787893066.446173:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907105afb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455570560:0@lo:400:kworker.0 00000100:00100000:0.0:1787893066.446204:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:0.0:1787893066.446210:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff907139e55500, transno 4294967321 00000004:00080000:0.0:1787893066.446220:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967323 committed transno 4294967323 00000100:00100000:0.0:1787893066.446241:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907105afaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455570816:0@lo:400:kworker.0 00000100:00100000:1.0:1787893066.448828:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455570176 00000100:00100000:1.0:1787893066.448845:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455570176 00000100:00100000:1.0:1787893066.448900:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1787893066.448910:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+19:3307:x1874741455570176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893066.448996:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+19:3307:x1874741455570176:12345-0@lo:400:kworker.0 Request processed in 88us (3432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893066.449003:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1787893066.449056:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455570688 00000100:00100000:1.0:1787893066.449060:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455570688 00000100:00100000:1.0:1787893066.449099:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455570304 00000100:00100000:1.0:1787893066.449102:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455570304 00000100:00100000:1.0:1787893066.449115:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455570432 00000100:00100000:1.0:1787893066.449118:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455570432 00000100:00100000:1.0:1787893066.449133:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787893066.449150:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874741455570688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893066.449186:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874741455570688:12345-0@lo:400:kworker.0 Request processed in 37us (3524us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893066.449202:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787893066.449215:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787893066.449220:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f57f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874741455570304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893066.449249:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f57f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874741455570304:12345-0@lo:400:kworker.0 Request processed in 29us (3535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893066.449255:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787893066.449278:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787893066.449284:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874741455570432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893066.449320:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874741455570432:12345-0@lo:400:kworker.0 Request processed in 37us (3496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893066.449326:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:1.0:1787893066.449603:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787893066.449609:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787893066.449673:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907105afa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874741455570432:0@lo:400:kworker.0 00000100:00100000:1.0:1787893066.449711:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907105afb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874741455570304:0@lo:400:kworker.0 00000100:00100000:1.0:1787893066.449721:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907105af8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22d910cf-711e-44e0-9acf-212404ada550:3307:1874741455570176:0@lo:400:kworker.0 00000100:00100000:1.0:1787893066.449730:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907105af8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874741455570688:0@lo:400:kworker.0 00000100:00100000:3.0:1787893066.525337:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893066.525700:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431472000 00000100:00100000:1.0:1787893066.525711:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431472000 00000100:00100000:1.0:1787893066.525841:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 238 00000100:00100000:1.0:1787893066.525854:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+18:11310:x1874741431472000:12345-192.168.202.29@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787893066.525978:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+18:11310:x1874741431472000:12345-192.168.202.29@tcp:60:lhsmtool_posix.0 Request processed in 126us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893066.526002:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 238 00000100:00080000:2.0:1787893066.528575:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787893066.538965:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893066.539117:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431472256 00000100:00100000:3.0:1787893066.539128:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431472256 00000100:00100000:3.0:1787893066.539198:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 65 00000100:00100000:3.0:1787893066.539209:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+18:11310:x1874741431472256:12345-192.168.202.29@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787893066.539821:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f472680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+19:11310:x1874741431472256:12345-192.168.202.29@tcp:35:lhsmtool_posix.0 Request processed in 610us (862us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1787893066.539838:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 65 00000100:00100000:1.0:1787893066.768374:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893066.768462:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431472384 00000100:00100000:2.0:1787893066.768475:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431472384 00000100:00100000:2.0:1787893066.768565:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 239 00000100:00100000:2.0:1787893066.768576:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107e81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db96701a-d972-4021-b77b-4d58b82fa12c+5:12108:x1874741431472384:12345-192.168.202.29@tcp:101:lsof.0 00010000:00010000:2.0:1787893066.768607:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893066.768632:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4b67b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b26d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893066.768704:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4b682 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893066.768739:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4b682 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893066.768785:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4b682 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893066.769008:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787893066.769013:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787893066.769111:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4b682 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893066.769146:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4b67b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b26d expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893066.769166:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4b682 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b26d expref: 6 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893066.769175:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907105cff800) 00010000:00010000:2.0:1787893066.769178:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787893066.769182:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9f400, rc 0) 00000100:00100000:2.0:1787893066.769249:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107e81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db96701a-d972-4021-b77b-4d58b82fa12c+6:12108:x1874741431472384:12345-192.168.202.29@tcp:101:lsof.0 Request processed in 674us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893066.769257:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 239 00000100:00080000:1.0:1787893066.769675:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787893066.825002:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787893066.955451:0:8104:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 394722695356ns, next at 395722692481ns, rc = 0 00000100:00100000:0.0:1787893066.955475:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787893066.955498:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455570944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787893066.955596:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893066.955679:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455570944 00000100:00100000:0.0:1787893066.955688:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455570944 00000100:00100000:0.0:1787893066.955737:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787893066.955747:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907003264700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455570944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787893066.955821:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787893066.955872:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907003264700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455570944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893066.955879:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787893066.955945:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455570944:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1787893067.100731:0:5870:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000100:00100000:1.0:1787893067.101007:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455571072:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787893067.101191:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893067.101340:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455571072 00000100:00100000:0.0:1787893067.101351:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455571072 00000100:00100000:0.0:1787893067.101561:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787893067.101572:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455571072:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1787893067.101911:0:6701:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1787893067.101915:0:6701:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1787893055 -> 1787893055 00002000:00010000:0.0:1787893067.101918:0:6701:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1787893055 -> 1787893055 00002000:00010000:0.0:1787893067.101938:0:6701:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787893055 -> 1787893055 00002000:00010000:0.0:1787893067.101941:0:6701:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1787893067.102002:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1874741455571072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 431us (811us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1787893067.102011:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000004:00080000:0.0:1787893067.102068:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff907137d3ea00/2, rc 0, transno 4294967324 00000100:00100000:0.0:1787893067.102075:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455571072:0@lo:2:osp-syn-1-0.0 00000020:00080000:1.0:1787893067.111296:0:5870:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1787893067.111437:0:5881:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1787893067.111452:0:5881:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:1.0:1787893067.111736:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000040:00080000:1.0:1787893067.337238:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787893067.337258:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787893067.337709:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1787893067.337717:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:0.0:1787893067.514984:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00010000:00010000:1.0:1787893067.849098:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893068.874310:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893069.366244:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893069.366308:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893069.366363:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893069.366388:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893069.366403:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431472640 00000100:00100000:1.0:1787893069.366418:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431472640 00000100:00100000:0.0:1787893069.366421:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893069.366463:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431472896 00000100:00100000:0.0:1787893069.366468:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431472896 00000100:00100000:1.0:1787893069.366501:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431473024 00000100:00100000:0.0:1787893069.366501:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431472768 00000100:00100000:1.0:1787893069.366504:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431473024 00000100:00100000:0.0:1787893069.366504:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431472768 00000100:00100000:0.0:1787893069.366529:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 104 00000100:00100000:1.0:1787893069.366532:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 173 00000100:00100000:1.0:1787893069.366541:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105af8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+18:2362:x1874741431472640:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1787893069.366541:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105af8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4829748d-dde1-497a-9623-0e4326f0972c+7:2362:x1874741431472896:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1787893069.366660:0:8105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 105 00000100:00100000:3.0:1787893069.366673:0:8105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105afb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4829748d-dde1-497a-9623-0e4326f0972c+5:2362:x1874741431472768:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1787893069.366895:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105af8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4829748d-dde1-497a-9623-0e4326f0972c+7:2362:x1874741431472896:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 355us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893069.366905:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 104 00000100:00100000:0.0:1787893069.366937:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 174 00000100:00100000:0.0:1787893069.366945:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105afa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db96701a-d972-4021-b77b-4d58b82fa12c+6:2362:x1874741431473024:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1787893069.366976:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105afa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db96701a-d972-4021-b77b-4d58b82fa12c+6:2362:x1874741431473024:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 32us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893069.367006:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 174 00000100:00080000:0.0:1787893069.367222:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787893069.367227:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787893069.367230:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787893069.367397:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105af8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+18:2362:x1874741431472640:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 856us (1168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893069.367405:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 173 00000100:00100000:2.0:1787893069.369270:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431472512 00000100:00100000:2.0:1787893069.369288:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431472512 00000100:00100000:2.0:1787893069.369379:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 302 00000100:00100000:2.0:1787893069.369390:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+13:2362:x1874741431472512:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1787893069.369528:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+13:2362:x1874741431472512:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 139us (3164us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893069.369537:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 302 00000100:00100000:3.0:1787893069.373707:0:8105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105afb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4829748d-dde1-497a-9623-0e4326f0972c+5:2362:x1874741431472768:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 7016us (7295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893069.373729:0:8105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 105 00010000:00010000:0.0:1787893069.900826:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893070.542580:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787893070.542620:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070011b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455571200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787893070.542735:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893070.547874:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455571200 00000100:00100000:0.0:1787893070.547899:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455571200 00000100:00100000:0.0:1787893070.548042:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787893070.548057:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712ebbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455571200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787893070.548289:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787893070.548630:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787893070.548716:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712ebbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455571200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 659us (5977us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893070.548726:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787893070.551336:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070011b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455571200:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787893070.921417:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893071.561203:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700198ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455571712:0@lo:400:kworker.0 00000100:00100000:2.0:1787893071.561328:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893071.561378:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907105afb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874741455571456:0@lo:400:kworker.0 00000100:00100000:0.0:1787893071.561421:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893071.561478:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907105afaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22d910cf-711e-44e0-9acf-212404ada550:3308:1874741455571328:0@lo:400:kworker.0 00000100:00100000:3.0:1787893071.561524:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893071.561584:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700198f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874741455571840:0@lo:400:kworker.0 00000100:00100000:3.0:1787893071.561624:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455571328 00000100:00100000:3.0:1787893071.561635:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455571328 00000100:00100000:3.0:1787893071.561707:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1787893071.561720:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+19:3308:x1874741455571328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893071.561803:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+19:3308:x1874741455571328:12345-0@lo:400:kworker.0 Request processed in 85us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893071.561811:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1787893071.582320:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455571712 00000100:00100000:0.0:1787893071.582339:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455571712 00000100:00100000:0.0:1787893071.582420:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787893071.582433:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070011b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455571712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893071.582554:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070011b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455571712:12345-0@lo:400:kworker.0 Request processed in 123us (21226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893071.582565:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787893071.582606:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700198c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874741455571584:0@lo:400:kworker.0 00000100:00100000:0.0:1787893071.582656:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893071.582703:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455571456 00000100:00100000:0.0:1787893071.582707:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455571456 00000100:00100000:0.0:1787893071.582777:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455571584 00000100:00100000:0.0:1787893071.582780:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455571584 00000100:00100000:0.0:1787893071.582813:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787893071.582820:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90700198f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874741455571456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893071.582857:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90700198f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874741455571456:12345-0@lo:400:kworker.0 Request processed in 39us (21436us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893071.582864:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787893071.582876:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787893071.582882:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90700198fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874741455571584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893071.582911:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90700198fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874741455571584:12345-0@lo:400:kworker.0 Request processed in 29us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893071.582916:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:0.0:1787893071.582955:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787893071.583794:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700198c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874741455571584:0@lo:400:kworker.0 00000100:00100000:0.0:1787893071.583851:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700198ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455571712:0@lo:400:kworker.0 00000100:00100000:0.0:1787893071.583887:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907105afb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874741455571456:0@lo:400:kworker.0 00000100:00100000:0.0:1787893071.583897:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700198c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455571968:0@lo:400:kworker.0 00000100:00100000:0.0:1787893071.583941:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893071.583996:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455571968 00000100:00100000:0.0:1787893071.584002:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455571968 00000100:00100000:0.0:1787893071.584048:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787893071.584056:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90700198ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455571968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893071.584123:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90700198ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455571968:12345-0@lo:400:kworker.0 Request processed in 58us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893071.584130:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:0.0:1787893071.584157:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787893071.584176:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1787893071.584183:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff907137d3ea00, transno 4294967324 00000100:00100000:0.0:1787893071.584197:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700198c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455571968:0@lo:400:kworker.0 00000100:00100000:1.0:1787893071.586495:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893071.586618:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907105afaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22d910cf-711e-44e0-9acf-212404ada550:3308:1874741455571328:0@lo:400:kworker.0 00000100:00100000:0.0:1787893071.586661:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455571840 00000100:00100000:0.0:1787893071.586671:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455571840 00000100:00080000:1.0:1787893071.586746:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787893071.586778:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787893071.586790:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874741455571840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893071.586898:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874741455571840:12345-0@lo:400:kworker.0 Request processed in 109us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893071.586907:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787893071.587525:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700198f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874741455571840:0@lo:400:kworker.0 00010000:00010000:3.0:1787893071.946172:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893072.073117:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787893072.073153:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700198c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455572096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787893072.073269:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893072.075712:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455572096 00000100:00100000:0.0:1787893072.075738:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455572096 00000100:00100000:0.0:1787893072.075831:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787893072.075844:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070010cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455572096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787893072.075899:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787893072.076017:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070010cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455572096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 176us (2748us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893072.076026:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787893072.076539:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700198c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455572096:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1787893072.124384:0:5870:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 11 committed 00000001:02000400:2.0:1787893072.445009:0:12835:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 00:57:49 (1787893069) 00010000:00010000:0.0:1787893072.969680:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893073.996648:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893074.488117:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893074.491578:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893074.491623:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893074.491654:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893074.491684:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893074.491738:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431473536 00000100:00100000:3.0:1787893074.491781:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431473536 00000100:00100000:3.0:1787893074.491854:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431473408 00000100:00100000:3.0:1787893074.491869:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431473408 00000100:00100000:3.0:1787893074.491899:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 108 00000100:00100000:3.0:1787893074.491911:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90700198ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4829748d-dde1-497a-9623-0e4326f0972c+7:2363:x1874741431473536:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1787893074.491991:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90700198ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4829748d-dde1-497a-9623-0e4326f0972c+7:2363:x1874741431473536:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 82us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893074.491999:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 108 00000100:00100000:3.0:1787893074.492016:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 109 00000100:00100000:3.0:1787893074.492022:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90700198e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4829748d-dde1-497a-9623-0e4326f0972c+5:2363:x1874741431473408:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1787893074.492059:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90700198e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4829748d-dde1-497a-9623-0e4326f0972c+5:2363:x1874741431473408:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 37us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893074.492076:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 109 00000100:00080000:3.0:1787893074.492107:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787893074.492112:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787893074.496277:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431473152 00000100:00100000:3.0:1787893074.496293:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431473152 00000100:00100000:3.0:1787893074.496366:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 304 00000100:00100000:3.0:1787893074.496376:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+13:2363:x1874741431473152:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1787893074.496456:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+13:2363:x1874741431473152:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 82us (4833us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893074.496463:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 304 00000100:00100000:2.0:1787893074.499863:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431473280 00000100:00100000:2.0:1787893074.499880:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431473280 00000100:00100000:2.0:1787893074.499983:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431473664 00000100:00100000:2.0:1787893074.499987:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431473664 00000100:00100000:0.0:1787893074.500082:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 178 00000100:00100000:0.0:1787893074.500096:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90700198c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+18:2363:x1874741431473280:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1787893074.500202:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90700198c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4829748d-dde1-497a-9623-0e4326f0972c+18:2363:x1874741431473280:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 108us (12182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893074.500210:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 178 00000100:00080000:3.0:1787893074.506878:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787893074.507449:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 179 00000100:00100000:2.0:1787893074.507463:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90700198ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db96701a-d972-4021-b77b-4d58b82fa12c+6:2363:x1874741431473664:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1787893074.507666:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90700198ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db96701a-d972-4021-b77b-4d58b82fa12c+6:2363:x1874741431473664:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 98us (15871us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893074.507677:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 179 00010000:00010000:3.0:1787893075.020576:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893075.657718:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070011b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455572224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787893075.657820:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893075.657967:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455572224 00000100:00100000:3.0:1787893075.657977:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455572224 00000100:00100000:3.0:1787893075.658072:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787893075.658084:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90700198d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455572224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787893075.658147:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787893075.658202:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90700198d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455572224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893075.658210:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787893075.658273:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070011b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455572224:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787893075.658404:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787893076.041012:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893076.684966:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700198e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455572736:0@lo:400:kworker.0 00000100:00100000:3.0:1787893076.685062:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893076.685138:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787893076.685144:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700198d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22d910cf-711e-44e0-9acf-212404ada550:3307:1874741455572352:0@lo:400:kworker.0 00000100:00100000:3.0:1787893076.685168:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893076.685190:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700198f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874741455572864:0@lo:400:kworker.0 00000100:00100000:3.0:1787893076.685213:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893076.685240:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455572352 00000100:00100000:3.0:1787893076.685248:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455572352 00000100:00100000:3.0:1787893076.685290:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1787893076.685298:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+19:3307:x1874741455572352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893076.685341:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22d910cf-711e-44e0-9acf-212404ada550+19:3307:x1874741455572352:12345-0@lo:400:kworker.0 Request processed in 44us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893076.685348:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1787893076.685391:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700198d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22d910cf-711e-44e0-9acf-212404ada550:3307:1874741455572352:0@lo:400:kworker.0 00000100:00100000:0.0:1787893076.685582:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455572736 00000100:00100000:0.0:1787893076.685587:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455572736 00000100:00100000:0.0:1787893076.685625:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787893076.685631:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907139e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455572736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893076.685668:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907139e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455572736:12345-0@lo:400:kworker.0 Request processed in 37us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893076.685674:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787893076.685692:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455572864 00000100:00100000:0.0:1787893076.685694:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455572864 00000100:00100000:0.0:1787893076.685723:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787893076.685729:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137f7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874741455572864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893076.685773:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137f7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874741455572864:12345-0@lo:400:kworker.0 Request processed in 44us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893076.685779:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00080000:0.0:1787893076.685792:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787893076.686247:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700198f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874741455572864:0@lo:400:kworker.0 00000100:00100000:3.0:1787893076.686257:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700198e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455572736:0@lo:400:kworker.0 00000100:00100000:2.0:1787893076.687164:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700198d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874741455572480:0@lo:400:kworker.0 00000100:00100000:2.0:1787893076.687223:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893076.687266:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700198dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455572992:0@lo:400:kworker.0 00000100:00100000:2.0:1787893076.687289:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893076.687321:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787893076.687328:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700198c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874741455572608:0@lo:400:kworker.0 00000100:00100000:2.0:1787893076.687351:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893076.687457:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455572480 00000100:00100000:0.0:1787893076.687465:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455572480 00000100:00100000:0.0:1787893076.687512:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455572608 00000100:00100000:0.0:1787893076.687516:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455572608 00000100:00100000:0.0:1787893076.687555:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787893076.687581:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070011b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874741455572480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893076.687637:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070011b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874741455572480:12345-0@lo:400:kworker.0 Request processed in 59us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893076.687644:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787893076.687662:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787893076.687668:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070011b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874741455572608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893076.687696:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070011b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874741455572608:12345-0@lo:400:kworker.0 Request processed in 29us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893076.687703:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00080000:0.0:1787893076.687719:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787893076.687746:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700198c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874741455572608:0@lo:400:kworker.0 00000100:00100000:0.0:1787893076.687788:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700198d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874741455572480:0@lo:400:kworker.0 00000100:00100000:3.0:1787893076.688250:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455572992 00000100:00100000:3.0:1787893076.688265:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455572992 00000100:00100000:3.0:1787893076.688324:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787893076.688332:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070011b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455572992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893076.688378:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070011b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455572992:12345-0@lo:400:kworker.0 Request processed in 48us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893076.688384:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787893076.688411:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700198dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455572992:0@lo:400:kworker.0 00000100:00080000:0.0:1787893076.689789:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787893077.065333:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893077.075335:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893077.075439:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431473920 00000100:00100000:1.0:1787893077.075452:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431473920 00000100:00100000:1.0:1787893077.075550:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 66 00000100:00100000:1.0:1787893077.075563:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070011b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+18:12331:x1874741431473920:12345-192.168.202.29@tcp:35:umount.0 00000100:00100000:1.0:1787893077.076260:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070011b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+19:12331:x1874741431473920:12345-192.168.202.29@tcp:35:umount.0 Request processed in 698us (938us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1787893077.076269:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 66 00000100:00080000:0.0:1787893077.076873:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787893077.085246:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893077.085906:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431474176 00000100:00100000:1.0:1787893077.085918:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431474176 00000100:00100000:1.0:1787893077.085980:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 67 00000100:00100000:1.0:1787893077.085989:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90700198d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+19:12331:x1874741431474176:12345-192.168.202.29@tcp:35:umount.0 00000100:00100000:1.0:1787893077.087267:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90700198d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+20:12331:x1874741431474176:12345-192.168.202.29@tcp:35:umount.0 Request processed in 1268us (2020us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1787893077.087278:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 67 00000100:00100000:2.0:1787893077.103400:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893077.103743:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431474432 00000100:00100000:3.0:1787893077.103948:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431474432 00000100:00100000:3.0:1787893077.104033:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 68 00000100:00100000:3.0:1787893077.104055:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907130449850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+20:12331:x1874741431474432:12345-192.168.202.29@tcp:35:umount.0 00000100:00100000:3.0:1787893077.105482:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907130449850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4829748d-dde1-497a-9623-0e4326f0972c+21:12331:x1874741431474432:12345-192.168.202.29@tcp:35:umount.0 Request processed in 1423us (2286us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1787893077.105494:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 68 00000100:00100000:2.0:1787893077.111470:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893077.111920:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431474688 00000100:00100000:1.0:1787893077.111934:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431474688 00000100:00100000:1.0:1787893077.112129:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 69 00000100:00100000:1.0:1787893077.112142:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070011b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+21:12331:x1874741431474688:12345-192.168.202.29@tcp:35:umount.0 00000100:00100000:1.0:1787893077.112941:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070011b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4829748d-dde1-497a-9623-0e4326f0972c+22:12331:x1874741431474688:12345-192.168.202.29@tcp:35:umount.0 Request processed in 798us (1482us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1787893077.112952:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 69 00000100:00100000:0.0:1787893077.128902:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893077.128989:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893077.129367:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431474816 00000100:00100000:3.0:1787893077.129379:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431474816 00000100:00100000:3.0:1787893077.129463:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431474944 00000100:00100000:3.0:1787893077.129467:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431474944 00000100:00100000:3.0:1787893077.129503:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 19 00000100:00100000:3.0:1787893077.129530:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90700198c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:18703558-96be-475d-879f-15397926f758+14:2363:x1874741431474816:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787893077.129554:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787893077.129678:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 20 00000100:00100000:0.0:1787893077.129690:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90700198df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:18703558-96be-475d-879f-15397926f758+14:2363:x1874741431474944:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893077.129699:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893077.129712:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90710153aa00/0x825e3f5022b4a660 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821adc0 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893077.129733:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893077.129825:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90700198df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:18703558-96be-475d-879f-15397926f758+13:2363:x1874741431474944:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 138us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893077.129851:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 20 00010000:00010000:3.0:1787893077.130373:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907104f46a00/0x825e3f5022b4a6fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821adf8 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893077.130387:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893077.131182:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90700198c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:18703558-96be-475d-879f-15397926f758+11:2363:x1874741431474816:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 1657us (2671us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893077.131192:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 19 00000100:00100000:2.0:1787893077.132675:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893077.132850:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431475456 00000100:00100000:3.0:1787893077.132860:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431475456 00000100:00100000:3.0:1787893077.132926:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 21 00000100:00100000:3.0:1787893077.132936:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070011b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:18703558-96be-475d-879f-15397926f758+11:2363:x1874741431475456:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787893077.132953:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893077.132977:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907137fc8a00/0x825e3f5022b4a8e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aec3 expref: 11 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893077.132996:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893077.133067:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070011b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:18703558-96be-475d-879f-15397926f758+10:2363:x1874741431475456:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 132us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893077.133075:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 21 00000100:00100000:2.0:1787893077.135473:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893077.135701:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431475328 00000100:00100000:3.0:1787893077.135710:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431475328 00000100:00100000:3.0:1787893077.135818:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 72 00000100:00100000:3.0:1787893077.135831:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071083a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4829748d-dde1-497a-9623-0e4326f0972c+7:2359:x1874741431475328:12345-192.168.202.29@tcp:9:umount.0 00000020:00000080:3.0:1787893077.135862:0:6700:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x825e3f5022b4ac33 00000020:00010000:3.0:1787893077.135870:0:6700:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9071184b6800: total 0 00000100:00080000:3.0:1787893077.135875:0:6700:0:(import.c:65:import_set_state_nolock()) ffff9071184b3000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787893077.135913:0:6700:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00080000:1.0:1787893077.136412:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787893077.138417:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071083a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4829748d-dde1-497a-9623-0e4326f0972c+5:2359:x1874741431475328:12345-192.168.202.29@tcp:9:umount.0 Request processed in 2576us (2942us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893077.138431:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 72 00000020:00010000:3.0:1787893077.138473:0:5837:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9071184b6800: total 0 00010000:00010000:3.0:1787893077.138517:0:5837:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9071184b6800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1787893077.138651:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054fb3861/0x825e3f5022b4b674 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b266 expref: 4 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893077.138689:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f700353/0x825e3f5022b4afd6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b098 expref: 3 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893077.138718:0:5837:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9071184b6800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1787893077.138729:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893077.138731:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893077.138733:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893077.154953:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893077.155442:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431475584 00000100:00100000:3.0:1787893077.155456:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431475584 00000100:00100000:3.0:1787893077.155570:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 73 00000100:00100000:3.0:1787893077.155874:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070010cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4829748d-dde1-497a-9623-0e4326f0972c+5:2359:x1874741431475584:12345-192.168.202.29@tcp:9:umount.0 00000020:00000080:3.0:1787893077.155914:0:6702:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x825e3f5022b4a9d2 00000100:00080000:3.0:1787893077.155926:0:6702:0:(import.c:65:import_set_state_nolock()) ffff9071184a9800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787893077.155977:0:6702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:2.0:1787893077.156178:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893077.156990:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070010cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4829748d-dde1-497a-9623-0e4326f0972c+2:2359:x1874741431475584:12345-192.168.202.29@tcp:9:umount.0 Request processed in 1119us (2045us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893077.158944:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 73 00000100:00080000:1.0:1787893077.159126:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787893077.171976:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893077.178872:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431476608 00000100:00100000:0.0:1787893077.178891:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431476608 00000100:00100000:0.0:1787893077.178977:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 240 00000100:00100000:0.0:1787893077.178991:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071083a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+22:2359:x1874741431476608:12345-192.168.202.29@tcp:39:umount.0 00000020:00000080:0.0:1787893077.179061:0:8281:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x825e3f5022b4a66e 00000020:00010000:0.0:1787893077.179084:0:8281:0:(genops.c:1921:obd_stale_export_put()) Put export ffff907139caf800: total 0 00000100:00080000:0.0:1787893077.179088:0:8281:0:(import.c:65:import_set_state_nolock()) ffff907139ca8800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787893077.179124:0:8281:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:2.0:1787893077.179886:0:7644:0:(genops.c:1907:obd_stale_export_get()) Get export ffff907139caf800: total 0 00010000:00010000:2.0:1787893077.179937:0:7644:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff907139caf800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1787893077.179976:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9071063d7500) 00010000:00010000:2.0:1787893077.179980:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787893077.179988:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e000/0x825e3f5022b4afc1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b091 expref: 21 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893077.180022:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff907102b84200) 00010000:00010000:2.0:1787893077.180025:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787893077.180029:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071013fde00/0x825e3f5022b4b635 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b251 expref: 20 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893077.180053:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff907102b84200) 00010000:00010000:2.0:1787893077.180056:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787893077.180060:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90710153bc00/0x825e3f5022b4b65f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b25f expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893077.180072:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9071063d7500) 00010000:00010000:2.0:1787893077.180074:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787893077.180077:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4af97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b083 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893077.180089:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9071063d7000) 00010000:00010000:2.0:1787893077.180091:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787893077.180111:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4b333 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b18d expref: 17 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893077.180126:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff907105cff400) 00010000:00010000:2.0:1787893077.180128:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787893077.180132:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f800/0x825e3f5022b4ac95 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821afbf expref: 16 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893077.180145:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff907105cffb00) 00010000:00010000:2.0:1787893077.180147:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787893077.180152:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b9c00/0x825e3f5022b4a938 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aed1 expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893077.180168:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9071063d7000) 00010000:00010000:2.0:1787893077.180171:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787893077.180174:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4b054 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0bb expref: 14 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893077.180187:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9071063d7500) 00010000:00010000:2.0:1787893077.180190:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787893077.180194:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9e600/0x825e3f5022b4aeb7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b04b expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893077.180207:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff907105cff400) 00010000:00010000:2.0:1787893077.180209:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787893077.180213:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071102b8000/0x825e3f5022b4a9a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aeed expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893077.180228:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff907102b84200) 00010000:00010000:2.0:1787893077.180236:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787893077.180241:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4b555 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b219 expref: 11 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893077.180260:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907105cff800) 00010000:00010000:2.0:1787893077.180263:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787893077.180267:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f000/0x825e3f5022b4b038 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b0b4 expref: 10 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893077.180279:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9071061f7700) 00010000:00010000:2.0:1787893077.180281:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893077.180284:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9600/0x825e3f5022b4a954 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aed8 expref: 9 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893077.180297:0:7644:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff907139caf800, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1787893077.180310:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893077.180312:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893077.180314:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893077.182082:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071083a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4829748d-dde1-497a-9623-0e4326f0972c+7:2359:x1874741431476608:12345-192.168.202.29@tcp:39:umount.0 Request processed in 3078us (10107us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1787893077.182103:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 240 00000100:00100000:2.0:1787893077.193551:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700198ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455573120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787893077.193651:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893077.198123:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455573120 00000100:00100000:0.0:1787893077.198141:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455573120 00000100:00100000:0.0:1787893077.198235:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787893077.198249:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071083a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455573120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787893077.198301:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787893077.198408:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071083a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455573120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 164us (4758us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893077.198416:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787893077.198639:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700198ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455573120:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1787893077.323393:0:5870:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4829748d-dde1-497a-9623-0e4326f0972c 00000001:00080000:2.0:1787893077.323413:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1787893077.327463:0:5870:0:(genops.c:885:class_export_put()) final put ffff907139caf800/4829748d-dde1-497a-9623-0e4326f0972c 00000020:00000080:0.0:1787893077.327707:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff907139caf800/4829748d-dde1-497a-9623-0e4326f0972c for lustre-MDT0000 00000020:00000080:0.0:1787893077.327990:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff907139ca8800 for lustre-MDT0000 00000040:00080000:3.0:1787893077.577568:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787893077.577589:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787893077.578081:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1787893077.578090:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00100000:2.0:1787893077.829361:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4829748d-dde1-497a-9623-0e4326f0972c 00000020:00000080:2.0:1787893077.829372:0:7656:0:(genops.c:885:class_export_put()) final put ffff9071184b6800/4829748d-dde1-497a-9623-0e4326f0972c 00000020:00000080:0.0:1787893077.829444:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9071184b6800/4829748d-dde1-497a-9623-0e4326f0972c for lustre-OST0001 00000020:00000080:0.0:1787893077.829520:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9071184b3000 for lustre-OST0001 00010000:00010000:3.0:1787893078.091923:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893079.113665:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893079.623640:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893079.623793:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431476736 00000100:00100000:3.0:1787893079.623806:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431476736 00000100:00100000:3.0:1787893079.623885:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 306 00000100:00100000:3.0:1787893079.623898:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+10:2361:x1874741431476736:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1787893079.634835:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:18703558-96be-475d-879f-15397926f758+10:2361:x1874741431476736:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 10002us (10271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893079.634877:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 306 00000100:00100000:2.0:1787893079.635282:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893079.635436:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431476864 00000100:00100000:1.0:1787893079.635504:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431476864 00000100:00100000:1.0:1787893079.635582:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 183 00000100:00100000:1.0:1787893079.635593:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e62ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db96701a-d972-4021-b77b-4d58b82fa12c+6:2360:x1874741431476864:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1787893079.635804:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e62ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db96701a-d972-4021-b77b-4d58b82fa12c+6:2360:x1874741431476864:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 85us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893079.635814:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 183 00000100:00080000:0.0:1787893079.636271:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787893079.660593:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893079.660697:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893079.671608:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893079.672324:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431476992 00000100:00100000:0.0:1787893079.672336:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431476992 00000100:00100000:0.0:1787893079.672406:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431477120 00000100:00100000:0.0:1787893079.672409:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431477120 00000100:00100000:0.0:1787893079.672442:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 22 00000100:00100000:2.0:1787893079.674933:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 23 00000100:00100000:2.0:1787893079.674961:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070010cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:18703558-96be-475d-879f-15397926f758+11:2363:x1874741431477120:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787893079.674986:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893079.675025:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9071421faa00/0x825e3f5022b4a747 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae37 expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893079.675057:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893079.675139:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070010cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:18703558-96be-475d-879f-15397926f758+10:2363:x1874741431477120:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 192us (14441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893079.675147:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 23 00000100:00100000:0.0:1787893079.676177:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070010cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:18703558-96be-475d-879f-15397926f758+9:2362:x1874741431476992:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893079.676197:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893079.676216:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9071102b8a00/0x825e3f5022b4a740 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821ae0d expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893079.676231:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893079.676275:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070010cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:18703558-96be-475d-879f-15397926f758+8:2362:x1874741431476992:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 3824us (15693us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893079.676282:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 22 00000100:00100000:1.0:1787893079.677882:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893079.678135:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431477504 00000100:00100000:0.0:1787893079.678146:0:8281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431477504 00000100:00100000:0.0:1787893079.678209:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 241 00000100:00100000:0.0:1787893079.678220:0:8281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070010cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db96701a-d972-4021-b77b-4d58b82fa12c+6:2359:x1874741431477504:12345-192.168.202.29@tcp:39:umount.0 00000020:00000080:0.0:1787893079.678262:0:8281:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x825e3f5022b4a755 00000020:00010000:0.0:1787893079.678273:0:8281:0:(genops.c:1921:obd_stale_export_put()) Put export ffff90713f9c6000: total 0 00000100:00080000:0.0:1787893079.678278:0:8281:0:(import.c:65:import_set_state_nolock()) ffff90713f9c1800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787893079.678301:0:8281:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:2.0:1787893079.679045:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431477248 00000100:00100000:2.0:1787893079.679122:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431477248 00000100:00100000:2.0:1787893079.679176:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 24 00000100:00100000:2.0:1787893079.679186:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107fa6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:18703558-96be-475d-879f-15397926f758+8:2362:x1874741431477248:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787893079.679200:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893079.679221:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907137fc8c00/0x825e3f5022b4a8dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821aebc expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893079.679238:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893079.679302:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107fa6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:18703558-96be-475d-879f-15397926f758+7:2362:x1874741431477248:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 117us (7704us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893079.679310:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 24 00000020:00010000:1.0:1787893079.680314:0:7644:0:(genops.c:1907:obd_stale_export_get()) Get export ffff90713f9c6000: total 0 00010000:00010000:1.0:1787893079.680322:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893079.680369:0:7644:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90713f9c6000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787893079.680403:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907105cff800) 00010000:00010000:1.0:1787893079.680408:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787893079.680418:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4b682 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b26d expref: 5 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893079.681010:0:7644:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90713f9c6000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1787893079.681037:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893079.681040:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893079.681042:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893079.681346:0:8281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070010cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db96701a-d972-4021-b77b-4d58b82fa12c+3:2359:x1874741431477504:12345-192.168.202.29@tcp:39:umount.0 Request processed in 3124us (3470us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1787893079.681357:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 241 00000100:00100000:1.0:1787893079.718938:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893079.720900:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431477760 00000100:00100000:3.0:1787893079.721114:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431477760 00000100:00100000:3.0:1787893079.721193:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 307 00000100:00100000:3.0:1787893079.721203:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+7:2359:x1874741431477760:12345-192.168.202.29@tcp:251:umount.0 00000020:00000080:3.0:1787893079.721253:0:5843:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x825e3f5022b4a64b 00000020:00010000:3.0:1787893079.721262:0:5843:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9071075bd800: total 0 00000100:00080000:3.0:1787893079.721266:0:5843:0:(import.c:65:import_set_state_nolock()) ffff9071075ba000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787893079.721374:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:18703558-96be-475d-879f-15397926f758+3:2359:x1874741431477760:12345-192.168.202.29@tcp:251:umount.0 Request processed in 170us (2444us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893079.721383:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 307 00000020:00010000:1.0:1787893079.721574:0:5837:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9071075bd800: total 0 00010000:00010000:1.0:1787893079.721629:0:5837:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9071075bd800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787893079.721666:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9071421fa800/0x825e3f5022b4a701 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821adff expref: 2 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893079.721702:0:5837:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9071075bd800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1787893079.721714:0:5837:0:(genops.c:885:class_export_put()) final put ffff9071075bd800/18703558-96be-475d-879f-15397926f758 00010000:00010000:1.0:1787893079.721731:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893079.721734:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893079.721736:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787893079.721790:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9071075bd800/18703558-96be-475d-879f-15397926f758 for MGS 00000020:00000080:1.0:1787893079.721828:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9071075ba000 for MGS 00010000:00010000:0.0:1787893080.148230:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893080.779979:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787893080.780002:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e62b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455573248:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787893080.780085:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893080.781953:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455573248 00000100:00100000:2.0:1787893080.781969:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455573248 00000100:00100000:2.0:1787893080.782055:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787893080.782069:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90700198df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455573248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787893080.782108:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787893080.782202:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90700198df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455573248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (2115us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893080.782210:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787893080.782798:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e62b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455573248:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787893080.790347:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1787893080.897384:0:6725:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4829748d-dde1-497a-9623-0e4326f0972c 00000020:00000080:2.0:1787893080.897396:0:6725:0:(genops.c:885:class_export_put()) final put ffff9071184ad000/4829748d-dde1-497a-9623-0e4326f0972c 00000020:00000080:0.0:1787893080.897554:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9071184ad000/4829748d-dde1-497a-9623-0e4326f0972c for lustre-OST0000 00000020:00000080:0.0:1787893080.897610:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9071184a9800 for lustre-OST0000 00010000:00010000:1.0:1787893081.162098:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893081.808870:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455573760:0@lo:400:kworker.0 00000100:00100000:1.0:1787893081.808947:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893081.809080:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787893081.809089:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22d910cf-711e-44e0-9acf-212404ada550:3307:1874741455573376:0@lo:400:kworker.0 00000100:00100000:1.0:1787893081.809122:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893081.809147:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874741455573888:0@lo:400:kworker.0 00000100:00100000:1.0:1787893081.809173:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893081.809214:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874741455573504:0@lo:400:kworker.0 00000100:00100000:1.0:1787893081.809243:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893081.809262:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455574016:0@lo:400:kworker.0 00000100:00100000:1.0:1787893081.809284:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893081.809303:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787893081.809308:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874741455573632:0@lo:400:kworker.0 00000100:00100000:1.0:1787893081.809329:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893081.809361:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455573760 00000100:00100000:1.0:1787893081.809369:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455573760 00000100:00100000:1.0:1787893081.809430:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455574016 00000100:00100000:1.0:1787893081.809434:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455574016 00000100:00100000:1.0:1787893081.809467:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787893081.809475:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070010ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455573760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893081.809531:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070010ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455573760:12345-0@lo:400:kworker.0 Request processed in 56us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893081.809539:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787893081.809555:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787893081.809561:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070010cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455574016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893081.809594:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070010cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455574016:12345-0@lo:400:kworker.0 Request processed in 33us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893081.809600:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787893081.809618:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455573376 00000100:00100000:1.0:1787893081.809622:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455573376 00000100:00100000:1.0:1787893081.809642:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1787893081.809648:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071065d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+19:3307:x1874741455573376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893081.809676:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071065d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22d910cf-711e-44e0-9acf-212404ada550+19:3307:x1874741455573376:12345-0@lo:400:kworker.0 Request processed in 28us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893081.809693:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1787893081.809725:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455573888 00000100:00100000:1.0:1787893081.809729:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455573888 00000100:00100000:1.0:1787893081.809777:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455573504 00000100:00100000:1.0:1787893081.809780:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455573504 00000100:00100000:1.0:1787893081.809792:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455573632 00000100:00100000:1.0:1787893081.809795:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455573632 00000100:00100000:1.0:1787893081.809809:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787893081.809816:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070010cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874741455573888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893081.809847:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070010cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874741455573888:12345-0@lo:400:kworker.0 Request processed in 32us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893081.809853:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787893081.809865:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787893081.809871:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070010cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874741455573504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893081.809898:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070010cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874741455573504:12345-0@lo:400:kworker.0 Request processed in 27us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893081.809903:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787893081.809913:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787893081.809918:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070010cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874741455573632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893081.809942:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070010cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874741455573632:12345-0@lo:400:kworker.0 Request processed in 24us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893081.809947:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00080000:1.0:1787893081.809976:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787893081.809981:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787893081.814159:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874741455573632:0@lo:400:kworker.0 00000100:00100000:1.0:1787893081.814180:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874741455573504:0@lo:400:kworker.0 00000100:00100000:1.0:1787893081.814216:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455574016:0@lo:400:kworker.0 00000100:00100000:1.0:1787893081.814267:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22d910cf-711e-44e0-9acf-212404ada550:3307:1874741455573376:0@lo:400:kworker.0 00000100:00100000:1.0:1787893081.814280:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874741455573888:0@lo:400:kworker.0 00000100:00100000:1.0:1787893081.814293:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455573760:0@lo:400:kworker.0 00010000:00010000:1.0:1787893082.185053:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893082.313328:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787893082.313355:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700198c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455574144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787893082.313438:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893082.321339:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455574144 00000100:00100000:0.0:1787893082.321357:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455574144 00000100:00100000:0.0:1787893082.321415:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787893082.321426:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90700198ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455574144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787893082.321482:0:6703:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787893082.325823:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90700198ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455574144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4387us (12374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893082.325838:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787893082.325953:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700198c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455574144:0@lo:13:osp-pre-1-0.0 00000020:01000004:3.0:1787893082.332854:0:13034:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1787893082.376162:0:13034:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1787893082.376218:0:13034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9071102b8600/0x825e3f5022b4a6d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a6d7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893082.376234:0:13034:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9071102b8600/0x825e3f5022b4a6d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a6d7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893082.376242:0:13034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9071102b8600/0x825e3f5022b4a6d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x825e3f5022b4a6d7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893082.376249:0:13034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.129@tcp lock: ffff9071102b8600/0x825e3f5022b4a6d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x825e3f5022b4a6d7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893082.376272:0:13034:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787893082.376278:0:13034:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787893082.376301:0:13034:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787893082.376321:0:13034:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787893082.376327:0:13034:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787893082.376359:0:13034:0:(import.c:65:import_set_state_nolock()) ffff90712e2ee000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1787893082.376626:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787893082.376633:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9071102b8600/0x825e3f5022b4a6d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x825e3f5022b4a6d7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893082.376641:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071102b8600 already unused, calling callback (ffffffffc1c05c20) 10000000:00010000:0.0:1787893082.376645:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9071102b8600/0x825e3f5022b4a6d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x825e3f5022b4a6d7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893082.376653:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9071102b8600/0x825e3f5022b4a6d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x825e3f5022b4a6d7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787893082.376666:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9071102b8600/0x825e3f5022b4a6d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x825e3f5022b4a6d7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787893082.376671:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787893082.376674:0:5836:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787893082.376676:0:5836:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787893082.376704:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9071102b8600/0x825e3f5022b4a6d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x825e3f5022b4a6d7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893082.376709:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787893082.376739:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9071102b8600/0x825e3f5022b4a6d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x825e3f5022b4a6d7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893082.376745:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9071102b8600/0x825e3f5022b4a6d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x825e3f5022b4a6d7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893082.376780:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893082.376782:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893082.376784:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893082.376829:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787893082.376850:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700198c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22d910cf-711e-44e0-9acf-212404ada550:3308:1874741455574400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787893082.376870:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137f7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874741455574272:0@lo:39:umount.0 00000001:00100000:0.0:1787893082.379242:0:5870:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of db96701a-d972-4021-b77b-4d58b82fa12c 00000001:00080000:0.0:1787893082.379260:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:0.0:1787893082.379266:0:5870:0:(genops.c:885:class_export_put()) final put ffff90713f9c6000/db96701a-d972-4021-b77b-4d58b82fa12c 00000020:00000080:0.0:1787893082.379293:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90713f9c6000/db96701a-d972-4021-b77b-4d58b82fa12c for lustre-MDT0000 00000020:00000080:0.0:1787893082.379346:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90713f9c1800 for lustre-MDT0000 00000100:00100000:0.0:1787893082.383273:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893082.387604:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455574272 00000100:00100000:1.0:1787893082.387620:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455574272 00000100:00100000:1.0:1787893082.387694:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787893082.387704:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90700198d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874741455574272:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787893082.387734:0:5849:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x825e3f5022b4a468 00000100:00080000:1.0:1787893082.387742:0:5849:0:(import.c:65:import_set_state_nolock()) ffff907139f59800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787893082.387903:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90700198d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3304:x1874741455574272:12345-0@lo:39:umount.0 Request processed in 199us (4636us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893082.387911:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:1.0:1787893082.387921:0:5849:0:(genops.c:885:class_export_put()) final put ffff907139f5a000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1787893082.387946:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787893082.388010:0:3304:0:(import.c:65:import_set_state_nolock()) ffff90712e2ee000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787893082.388031:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137f7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874741455574272:0@lo:39:umount.0 00000020:00000080:1.0:1787893082.388059:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff907139f5a000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787893082.388122:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff907139f59800 for lustre-MDT0000 00000100:00100000:3.0:1787893082.389414:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787893082.389472:0:13034:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787893082.389477:0:13034:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787893082.389482:0:13034:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:0.0:1787893082.390304:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455574400 00000100:00100000:0.0:1787893082.390316:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455574400 00000100:00100000:0.0:1787893082.390554:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787893082.390566:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137f7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22d910cf-711e-44e0-9acf-212404ada550+19:3308:x1874741455574400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787893082.390596:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893082.390617:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9071102b8800/0x825e3f5022b4a6d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x825e3f5022b4a6d0 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893082.390634:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893082.390694:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137f7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22d910cf-711e-44e0-9acf-212404ada550+18:3308:x1874741455574400:12345-0@lo:103:ldlm_bl.0 Request processed in 131us (1286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893082.390702:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1787893082.391333:0:13034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9071102b9800/0x825e3f5022b4a6de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a6e5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893082.391345:0:13034:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9071102b9800/0x825e3f5022b4a6de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a6e5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893082.391353:0:13034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9071102b9800/0x825e3f5022b4a6de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x825e3f5022b4a6e5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893082.391361:0:13034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.129@tcp lock: ffff9071102b9800/0x825e3f5022b4a6de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x825e3f5022b4a6e5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893082.391422:0:13034:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787893082.391428:0:13034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9071421fb200/0x825e3f5022b4a605 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a60c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893082.391436:0:13034:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9071421fb200/0x825e3f5022b4a605 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a60c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893082.391443:0:13034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9071421fb200/0x825e3f5022b4a605 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x825e3f5022b4a60c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893082.391459:0:13034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.129@tcp lock: ffff9071421fb200/0x825e3f5022b4a605 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x825e3f5022b4a60c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893082.398670:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700198c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22d910cf-711e-44e0-9acf-212404ada550:3308:1874741455574400:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787893082.399861:0:13034:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787893082.399886:0:13034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff907104f46400/0x825e3f5022b4a907 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a90e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893082.399898:0:13034:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff907104f46400/0x825e3f5022b4a907 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a90e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893082.399906:0:13034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff907104f46400/0x825e3f5022b4a907 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x825e3f5022b4a90e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893082.399912:0:13034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.129@tcp lock: ffff907104f46400/0x825e3f5022b4a907 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x825e3f5022b4a90e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893082.399928:0:13034:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1787893082.399934:0:13034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff90710153ae00/0x825e3f5022b4a3b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a3c0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893082.399940:0:13034:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff90710153ae00/0x825e3f5022b4a3b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a3c0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893082.399946:0:13034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff90710153ae00/0x825e3f5022b4a3b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x825e3f5022b4a3c0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893082.399952:0:13034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.129@tcp lock: ffff90710153ae00/0x825e3f5022b4a3b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x825e3f5022b4a3c0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893082.399980:0:13034:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1787893082.399984:0:13034:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1787893082.400036:0:13034:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1787893082.400042:0:13034:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1787893082.400047:0:13034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787893082.400055:0:13034:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1787893082.400063:0:13034:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff90713f778000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787893082.400069:0:13034:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff90713f77f000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787893082.400074:0:13034:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff90712ebcb370) has exports, disconnecting them 00000020:00080000:3.0:1787893082.400079:0:13034:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90713f778000), last request at 1787893081 00000020:00000080:3.0:1787893082.400089:0:13034:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x825e3f5022b4a5cd 00010000:00010000:2.0:1787893082.400107:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00080000:3.0:1787893082.400108:0:13034:0:(import.c:65:import_set_state_nolock()) ffff90713f77b000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1787893082.400119:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9071102b9800/0x825e3f5022b4a6de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x825e3f5022b4a6e5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893082.400130:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071102b9800 already unused, calling callback (ffffffffc1c05c20) 10000000:00010000:2.0:1787893082.400134:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9071102b9800/0x825e3f5022b4a6de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x825e3f5022b4a6e5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893082.400145:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9071102b9800/0x825e3f5022b4a6de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x825e3f5022b4a6e5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787893082.400162:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9071102b9800/0x825e3f5022b4a6de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x825e3f5022b4a6e5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787893082.400168:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787893082.400171:0:5836:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1787893082.400173:0:5836:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:1.0:1787893082.400227:0:7644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787893082.400236:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9071102b9800/0x825e3f5022b4a6de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x825e3f5022b4a6e5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893082.400243:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9071421fb200/0x825e3f5022b4a605 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x825e3f5022b4a60c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893082.400245:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787893082.400254:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fb200 already unused, calling callback (ffffffffc1c05c20) 10000000:00010000:1.0:1787893082.400258:0:7644:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9071421fb200/0x825e3f5022b4a605 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x825e3f5022b4a60c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893082.400267:0:7644:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9071421fb200/0x825e3f5022b4a605 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x825e3f5022b4a60c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787893082.400274:0:7644:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9071421fb200/0x825e3f5022b4a605 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x825e3f5022b4a60c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893082.400275:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9071102b9800/0x825e3f5022b4a6de lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x825e3f5022b4a6e5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893082.400289:0:7644:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787893082.400293:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9071102b9800/0x825e3f5022b4a6de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x825e3f5022b4a6e5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893082.400294:0:7644:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1787893082.400298:0:7644:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1787893082.400316:0:7644:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9071421fb200/0x825e3f5022b4a605 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x825e3f5022b4a60c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893082.400325:0:7644:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787893082.400326:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787893082.400332:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff907104f46400/0x825e3f5022b4a907 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x825e3f5022b4a90e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893082.400340:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f46400 already unused, calling callback (ffffffffc1c05c20) 10000000:00010000:2.0:1787893082.400344:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff907104f46400/0x825e3f5022b4a907 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x825e3f5022b4a90e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893082.400347:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9071421fb200/0x825e3f5022b4a605 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x825e3f5022b4a60c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893082.400355:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff907104f46400/0x825e3f5022b4a907 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x825e3f5022b4a90e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893082.400358:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9071421fb200/0x825e3f5022b4a605 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x825e3f5022b4a60c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787893082.400375:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff907104f46400/0x825e3f5022b4a907 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x825e3f5022b4a90e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893082.400378:0:7644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:2.0:1787893082.400385:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787893082.400386:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff90710153ae00/0x825e3f5022b4a3b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x825e3f5022b4a3c0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787893082.400388:0:5836:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787893082.400392:0:5836:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787893082.400399:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153ae00 already unused, calling callback (ffffffffc1c05c20) 10000000:00010000:1.0:1787893082.400410:0:7644:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff90710153ae00/0x825e3f5022b4a3b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x825e3f5022b4a3c0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893082.400411:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff907104f46400/0x825e3f5022b4a907 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x825e3f5022b4a90e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893082.400427:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787893082.400428:0:7644:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff90710153ae00/0x825e3f5022b4a3b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x825e3f5022b4a3c0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893082.400435:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff907104f46400/0x825e3f5022b4a907 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x825e3f5022b4a90e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787893082.400438:0:7644:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff90710153ae00/0x825e3f5022b4a3b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x825e3f5022b4a3c0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893082.400447:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff907104f46400/0x825e3f5022b4a907 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x825e3f5022b4a90e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893082.400456:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893082.400458:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787893082.400463:0:7644:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:2.0:1787893082.400466:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787893082.400467:0:7644:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1787893082.400471:0:7644:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00100000:2.0:1787893082.400477:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1787893082.400490:0:7644:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff90710153ae00/0x825e3f5022b4a3b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x825e3f5022b4a3c0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893082.400498:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22d910cf-711e-44e0-9acf-212404ada550:3307:1874741455574528:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787893082.400499:0:7644:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787893082.400509:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff90710153ae00/0x825e3f5022b4a3b9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x825e3f5022b4a3c0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893082.400515:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff90710153ae00/0x825e3f5022b4a3b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x825e3f5022b4a3c0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893082.400529:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893082.400531:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893082.400533:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893082.400546:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455574656:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787893082.400578:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893082.400586:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787893082.400599:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22d910cf-711e-44e0-9acf-212404ada550:3308:1874741455574912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787893082.400614:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893082.400646:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787893082.400653:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455574528 00000100:00100000:2.0:1787893082.400661:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455574528 00000100:00100000:1.0:1787893082.400661:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455574784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787893082.400692:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1787893082.400803:0:13034:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90713f778000): rc 0 00000020:00000080:3.0:1787893082.400807:0:13034:0:(genops.c:885:class_export_put()) final put ffff90713f778000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1787893082.400818:0:13034:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90713f77f000), last request at 1787893081 00000020:00000080:3.0:1787893082.400822:0:13034:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x825e3f5022b4a502 00000100:00080000:3.0:1787893082.400828:0:13034:0:(import.c:65:import_set_state_nolock()) ffff90713f77a800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787893082.400841:0:13034:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90713f77f000): rc 0 00000020:00000080:3.0:1787893082.400843:0:13034:0:(genops.c:885:class_export_put()) final put ffff90713f77f000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1787893082.400851:0:13034:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa30dc1c5bae0 00000100:00080000:3.0:1787893082.400871:0:13034:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787893082.400874:0:13034:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:3.0:1787893082.400889:0:13034:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787893082.400903:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455574656 00000100:00100000:2.0:1787893082.400909:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455574656 00000100:00100000:2.0:1787893082.400929:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455574784 00000100:00100000:2.0:1787893082.400932:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455574784 00000100:00100000:2.0:1787893082.400951:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1787893082.400957:0:13034:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1787893082.400962:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e62a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22d910cf-711e-44e0-9acf-212404ada550+20:3307:x1874741455574528:12345-0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1787893082.400976:0:13034:0:(import.c:65:import_set_state_nolock()) ffff907129bbe800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1787893082.400979:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:3.0:1787893082.401001:0:13034:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787893082.401005:0:13034:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00010000:00010000:2.0:1787893082.401008:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907104f46c00/0x825e3f5022b4a6e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x825e3f5022b4a6de expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787893082.401026:0:13034:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:2.0:1787893082.401026:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:3.0:1787893082.401087:0:13034:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1787893082.401099:0:13034:0:(import.c:65:import_set_state_nolock()) ffff907139bb2000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787893082.401216:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e62a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22d910cf-711e-44e0-9acf-212404ada550+19:3307:x1874741455574528:12345-0@lo:103:ldlm_bl.0 Request processed in 255us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893082.401225:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787893082.401248:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787893082.401255:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070010ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22d910cf-711e-44e0-9acf-212404ada550+18:3305:x1874741455574656:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787893082.401262:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f564e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874741455575040:0@lo:9:umount.0 00010000:00010000:2.0:1787893082.401264:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893082.401276:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9071013fce00/0x825e3f5022b4a60c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x825e3f5022b4a605 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893082.401290:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893082.401301:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893082.401327:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874741455575168:0@lo:9:umount.0 00000100:00100000:2.0:1787893082.401331:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070010ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22d910cf-711e-44e0-9acf-212404ada550+17:3305:x1874741455574656:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893082.401350:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787893082.401355:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893082.401385:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455575040 00000100:00100000:1.0:1787893082.401390:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455575040 00000100:00100000:2.0:1787893082.401412:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787893082.401420:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070010cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22d910cf-711e-44e0-9acf-212404ada550+16:3305:x1874741455574784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787893082.401428:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787893082.401433:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455575168 00000100:00100000:1.0:1787893082.401438:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455575168 00010000:00010000:2.0:1787893082.401440:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907104f47a00/0x825e3f5022b4a90e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x825e3f5022b4a907 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893082.401449:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893082.401470:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070010cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22d910cf-711e-44e0-9acf-212404ada550+15:3305:x1874741455574784:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893082.401476:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787893082.401520:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22d910cf-711e-44e0-9acf-212404ada550:3307:1874741455574528:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787893082.401542:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893082.401545:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787893082.401554:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070010cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874741455575040:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787893082.401577:0:6700:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x825e3f5022b4a55d 00000100:00080000:1.0:1787893082.401583:0:6700:0:(import.c:65:import_set_state_nolock()) ffff90711b94f800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787893082.401623:0:6700:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1787893082.401947:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070010cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3304:x1874741455575040:12345-0@lo:9:umount.0 Request processed in 393us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893082.401954:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787893082.401969:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787893082.401976:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070010cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874741455575168:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787893082.401999:0:6700:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x825e3f5022b4a636 00000100:00080000:1.0:1787893082.402005:0:6700:0:(import.c:65:import_set_state_nolock()) ffff907139bb2800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787893082.402024:0:6700:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000020:00080000:3.0:1787893082.402229:0:13034:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff90712ebcb370) has no exports 00000020:00000080:3.0:1787893082.402284:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90713f778000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1787893082.402326:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90713f77f000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787893082.402349:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90713f77b000 for lustre-MDT0000 00000020:00000080:3.0:1787893082.402354:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90713f77a800 for lustre-MDT0000 00010000:00010000:0.0:1787893082.402618:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893082.402623:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787893082.402811:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787893082.402849:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455574784:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787893082.402860:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:22d910cf-711e-44e0-9acf-212404ada550:3305:1874741455574656:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787893082.402914:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787893082.403126:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893082.403138:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455574912 00000100:00100000:2.0:1787893082.403143:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455574912 00000100:00100000:2.0:1787893082.403189:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787893082.403196:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90700198dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22d910cf-711e-44e0-9acf-212404ada550+15:3308:x1874741455574912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787893082.403208:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893082.403221:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9071421fac00/0x825e3f5022b4a3c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x825e3f5022b4a3b9 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893082.403239:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893082.403278:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90700198dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22d910cf-711e-44e0-9acf-212404ada550+14:3308:x1874741455574912:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893082.403286:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787893082.403329:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:22d910cf-711e-44e0-9acf-212404ada550:3308:1874741455574912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787893082.403355:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070010cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3304:x1874741455575168:12345-0@lo:9:umount.0 Request processed in 1377us (1998us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893082.403364:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1787893082.403405:0:3304:0:(import.c:65:import_set_state_nolock()) ffff907129bbe800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787893082.403429:0:3304:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787893082.403432:0:3304:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787893082.403436:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f564e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874741455575040:0@lo:9:umount.0 00000100:00080000:1.0:1787893082.403511:0:3304:0:(import.c:65:import_set_state_nolock()) ffff907139bb2000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787893082.403521:0:3304:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787893082.403523:0:3304:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787893082.403526:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874741455575168:0@lo:9:umount.0 00010000:00010000:1.0:1787893082.403546:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787893082.426046:0:13034:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff90712ebcb370) has no exports 00000020:00000080:3.0:1787893082.495892:0:13034:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x825e3f5022b4a414 00000020:00000080:3.0:1787893082.495915:0:13034:0:(genops.c:885:class_export_put()) final put ffff907139199800/lustre-QMT0000_UUID 00000020:01000000:3.0:1787893082.495941:0:13034:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1787893082.496248:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff907139199800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1787893082.496411:0:13034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787893082.496425:0:13034:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787893082.496431:0:13034:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff907107348000) has no exports 00000020:00000080:2.0:1787893082.496935:0:13034:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x825e3f5022b4a40d 00000020:00000080:2.0:1787893082.496943:0:13034:0:(genops.c:885:class_export_put()) final put ffff90713ad84000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787893082.497015:0:13034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787893082.497023:0:13034:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787893082.497026:0:13034:0:(genops.c:885:class_export_put()) final put ffff90712e2da800/lustre-QMT0000_UUID 00000020:00000080:2.0:1787893082.497028:0:13034:0:(genops.c:844:class_export_destroy()) destroying export ffff90712e2da800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1787893082.497037:0:13034:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1787893082.497198:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90713ad84000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787893082.497253:0:13034:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9071074db060 - data ffff90713fd93360/ffff907137ffd400 00000020:01000000:2.0:1787893082.497391:0:13034:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90711179b0c0 - data ffff90710e2c8000/ffff907107ff2c00 00000001:00000004:2.0:1787893082.520949:0:13034:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00080000:2.0:1787893082.654392:0:13034:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787893082.654405:0:13034:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1787893082.654428:0:13034:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787893082.654431:0:13034:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787893082.657147:0:7026:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787893082.657158:0:7026:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1787893082.657175:0:7026:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1787893082.665896:0:13034:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787893082.665908:0:13034:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1787893082.665936:0:13034:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787893082.665939:0:13034:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787893082.666413:0:8103:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787893082.666419:0:8103:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1787893082.666429:0:8103:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1787893082.754727:0:13034:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x825e3f5022b4a3dc 00000020:00000080:0.0:1787893082.754741:0:13034:0:(genops.c:885:class_export_put()) final put ffff90712e2ed800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787893082.756277:0:13034:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x825e3f5022b4a3f1 00000020:00000080:2.0:1787893082.756293:0:13034:0:(genops.c:885:class_export_put()) final put ffff90712ebd1000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787893082.756301:0:13034:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1787893082.756307:0:13034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787893082.756318:0:13034:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787893082.756322:0:13034:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff90712ebc99b8) has no exports 00000004:01000000:2.0:1787893082.756497:0:13034:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787893082.756509:0:13034:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x825e3f5022b4a62f 00000020:00000080:2.0:1787893082.756514:0:13034:0:(genops.c:885:class_export_put()) final put ffff907139cab800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787893082.756521:0:13034:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787893082.756524:0:13034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787893082.756532:0:13034:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787893082.756535:0:13034:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff90712ea7cd28) has no exports 00000020:00000080:2.0:1787893082.756553:0:13034:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x825e3f5022b4a628 00000020:00000080:2.0:1787893082.756557:0:13034:0:(genops.c:885:class_export_put()) final put ffff907139bb5000/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1787893082.756972:0:13034:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787893082.756978:0:13034:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787893082.756983:0:13034:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1787893082.757002:0:13034:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787893082.757005:0:13034:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787893082.757043:0:13034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787893082.757051:0:13034:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787893082.757056:0:13034:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x825e3f5022b4a548 00000020:00000080:2.0:1787893082.757060:0:13034:0:(genops.c:885:class_export_put()) final put ffff90713ac84000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787893082.757065:0:13034:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787893082.757069:0:13034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787893082.757073:0:13034:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787893082.757075:0:13034:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff907107ef99b8) has no exports 00000020:00000080:2.0:1787893082.757078:0:13034:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x825e3f5022b4a541 00000020:00000080:2.0:1787893082.757082:0:13034:0:(genops.c:885:class_export_put()) final put ffff907129bb8800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1787893082.757429:0:13034:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787893082.757433:0:13034:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787893082.757435:0:13034:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1787893082.757438:0:13034:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787893082.757440:0:13034:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787893082.757462:0:13034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787893082.757466:0:13034:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787893082.757492:0:13034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787893082.757494:0:13034:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787893082.757519:0:13034:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x825e3f5022b4a3f8 00000020:00000080:2.0:1787893082.757524:0:13034:0:(genops.c:885:class_export_put()) final put ffff90712ebd6000/lustre-MDD0000_UUID 00000020:01000000:2.0:1787893082.757528:0:13034:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1787893082.757530:0:13034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787893082.757533:0:13034:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787893082.757535:0:13034:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff90712ebc8000) has no exports 00000020:00000080:2.0:1787893082.757562:0:13034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787893082.757565:0:13034:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1787893082.757568:0:13034:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x825e3f5022b4a3ff 00000020:00000080:2.0:1787893082.757571:0:13034:0:(genops.c:885:class_export_put()) final put ffff90712ebd3800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787893082.757579:0:13034:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90710510c800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1787893082.757582:0:13034:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90710510c800 3 00000020:01000004:2.0:1787893082.757585:0:13034:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90710510c800 from lustre-MDT0000 00000020:00000080:2.0:1787893082.757604:0:13034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787893082.757606:0:13034:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1787893082.757608:0:13034:0:(genops.c:885:class_export_put()) final put ffff90712e2ea000/lustre-MDT0000_UUID 00000020:00000080:2.0:1787893082.757611:0:13034:0:(genops.c:844:class_export_destroy()) destroying export ffff90712e2ea000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1787893082.757619:0:13034:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1787893082.757677:0:13034:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1787893082.757679:0:13034:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1787893082.757682:0:13034:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1787893082.757684:0:13034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787893082.757686:0:13034:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787893082.757693:0:13034:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff907105a75000 22d910cf-711e-44e0-9acf-212404ada550 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787893082.757697:0:13034:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9071073499b8) has exports, disconnecting them 00000020:00080000:2.0:1787893082.757701:0:13034:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff907105a75000), last request at 1787892845 00000020:00000080:2.0:1787893082.757714:0:13034:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x825e3f5022b4a39d 00000020:00010000:2.0:1787893082.757717:0:13034:0:(genops.c:1921:obd_stale_export_put()) Put export ffff907105a75000: total 8 00000100:00080000:2.0:1787893082.757721:0:13034:0:(import.c:65:import_set_state_nolock()) ffff907105a70000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787893082.757747:0:13034:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff907105a75000): rc 0 00000020:00080000:2.0:1787893082.757779:0:13034:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9071073499b8) has no exports 00000020:00010000:0.0:1787893082.757807:0:5837:0:(genops.c:1907:obd_stale_export_get()) Get export ffff907105a75000: total 8 00010000:00010000:0.0:1787893082.757837:0:5837:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff907105a75000, canceled 0 locks, left on hash table 8. 00000100:00100000:2.0:1787893082.757838:0:5841:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff907107f7b400:5841] 0 exiting: rc = 1 00010000:00010000:0.0:1787893082.757868:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907103f06e00/0x825e3f5022b4a6bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x825e3f5022b4a6b4 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893082.757883:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907104f47400/0x825e3f5022b4a6ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x825e3f5022b4a6a6 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893082.757906:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9071102b9e00/0x825e3f5022b4a6c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x825e3f5022b4a6c2 expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893082.757918:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9071421fa600/0x825e3f5022b4a900 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x825e3f5022b4a8f9 expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893082.757928:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9071013fc600/0x825e3f5022b4a4b5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x825e3f5022b4a4ae expref: 5 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893082.757942:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9071421fae00/0x825e3f5022b4a6f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x825e3f5022b4a6ec expref: 4 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893082.757964:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907137fc8e00/0x825e3f5022b4a8f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x825e3f5022b4a8eb expref: 3 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893082.757979:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9071102b8c00/0x825e3f5022b4a69f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x825e3f5022b4a698 expref: 2 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893082.757999:0:5837:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff907105a75000, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1787893082.758015:0:5837:0:(genops.c:885:class_export_put()) final put ffff907105a75000/22d910cf-711e-44e0-9acf-212404ada550 00010000:00010000:0.0:1787893082.758020:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893082.758022:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893082.758024:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787893082.762237:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90712e2ed800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787893082.762282:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90712ebd1000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1787893082.762291:0:37:0:(genops.c:885:class_export_put()) final put ffff90712e2e9000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787893082.762294:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90712e2e9000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1787893082.762306:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787893082.762513:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff907139cab800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787893082.762521:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff907139bb5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787893082.762527:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff907139bb2000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787893082.762532:0:37:0:(genops.c:885:class_export_put()) final put ffff907139bb7000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787893082.762535:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff907139bb7000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1787893082.762538:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787893082.762568:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90713ac84000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787893082.762591:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff907129bb8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787893082.762596:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff907129bbe800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787893082.762601:0:37:0:(genops.c:885:class_export_put()) final put ffff90713788f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787893082.762603:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90713788f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1787893082.762605:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787893082.762671:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90712ebd6000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1787893082.762675:0:37:0:(genops.c:885:class_export_put()) final put ffff90712e2ee800/lustre-MDD0000_UUID 00000020:00000080:3.0:1787893082.762677:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90712e2ee800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1787893082.762680:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1787893082.762851:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90712ebd3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787893082.762856:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff907105a75000/22d910cf-711e-44e0-9acf-212404ada550 for MGS 00000020:00000080:3.0:1787893082.762901:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff907105a70000 for MGS 00000100:00100000:0.0:1787893082.763168:0:5842:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff907107f7a800:5842] 1 exiting: rc = 0 00000100:00100000:3.0:1787893082.765712:0:5843:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff907105a69200:5843] 2 exiting: rc = 0 00000100:00100000:2.0:1787893082.766243:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766252:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766256:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766260:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766265:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766270:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766295:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766299:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766304:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766308:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766314:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766318:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766323:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766328:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766332:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766339:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766344:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766348:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766352:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766356:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766360:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766364:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766367:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766371:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766375:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766378:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766382:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766386:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766390:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766395:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766402:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766408:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766413:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766420:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766425:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766430:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766436:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766441:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766458:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766464:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766470:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766484:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766490:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766496:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766501:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766507:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766513:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766521:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766527:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766532:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766539:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766544:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766551:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766556:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766561:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766566:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766572:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766577:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766582:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766586:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766590:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766594:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766598:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.766601:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1787893082.766931:0:13034:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787893082.766934:0:13034:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1787893082.772087:0:13034:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9071102fcc00 - data ffff90713fdf66c0/ffff90713f87cc00 00000020:01000000:0.0:1787893082.772190:0:13034:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9071103b55a0 - data ffff907131737948/ffff907105a93000 00000020:00000080:0.0:1787893082.773120:0:13034:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x825e3f5022b4a381 00000020:00000080:0.0:1787893082.773130:0:13034:0:(genops.c:885:class_export_put()) final put ffff9071086e0000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787893082.773146:0:13034:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90710510c800 from MGS, refs=2 00000020:01000004:0.0:1787893082.773163:0:13034:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90710510c800 2 00000020:01000004:0.0:1787893082.773166:0:13034:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90710510c800 from MGS 00000020:00000080:0.0:1787893082.773197:0:13034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787893082.773204:0:13034:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1787893082.773208:0:13034:0:(genops.c:885:class_export_put()) final put ffff9071086e6000/MGS 00000020:00000080:0.0:1787893082.773211:0:13034:0:(genops.c:844:class_export_destroy()) destroying export ffff9071086e6000/MGS for MGS 00000020:01000000:0.0:1787893082.773219:0:13034:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1787893082.773276:0:13034:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1787893082.773280:0:13034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787893082.773286:0:13034:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787893082.773293:0:13034:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff90712e2e8000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787893082.773299:0:13034:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff90712ebccd28) has exports, disconnecting them 00000020:00080000:0.0:1787893082.773303:0:13034:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff90712e2e8000), last request at 1787892846 00000020:00000080:0.0:1787893082.773307:0:13034:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x825e3f5022b4a44c 00000020:00080000:0.0:1787893082.773314:0:13034:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90712e2e8000): rc 0 00000020:00000080:0.0:1787893082.773319:0:13034:0:(genops.c:885:class_export_put()) final put ffff90712e2e8000/lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1787893082.774174:0:13034:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1787893082.774181:0:13034:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000020:00000080:2.0:1787893082.774183:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9071086e0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:0.0:1787893082.774185:0:13034:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787893082.774191:0:13034:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787893082.774194:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90712e2e8000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787893082.774212:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90712e2ee000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787893082.774342:0:13034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787893082.774348:0:13034:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1787893082.774352:0:13034:0:(genops.c:885:class_export_put()) final put ffff90712ebd5800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1787893082.774355:0:13034:0:(genops.c:844:class_export_destroy()) destroying export ffff90712ebd5800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1787893082.774360:0:13034:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1787893082.774617:0:13034:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90710510c800 1 00000020:00000080:0.0:1787893082.774623:0:13034:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x825e3f5022b4a373 00000020:00000080:0.0:1787893082.774627:0:13034:0:(genops.c:885:class_export_put()) final put ffff9071086e4800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1787893082.774687:0:13034:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1787893082.774693:0:13034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787893082.774698:0:13034:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787893082.774710:0:13034:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff90711bad99b8) has no exports 00000020:00000080:2.0:1787893082.775960:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9071086e4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787893082.806998:0:13034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787893082.807016:0:13034:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1787893082.807023:0:13034:0:(genops.c:885:class_export_put()) final put ffff90710510e000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787893082.807028:0:13034:0:(genops.c:844:class_export_destroy()) destroying export ffff90710510e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1787893082.807038:0:13034:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1787893082.807164:0:13034:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90710510b000 00000020:01000000:3.0:1787893082.807196:0:13034:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1787893082.807199:0:13034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787893082.807207:0:13034:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787893082.807214:0:13034:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff90710734b370) has no exports 00000100:00100000:0.0:1787893082.807396:0:5848:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9071073dfe00:5848] 1 exiting: rc = 0 00000100:00100000:1.0:1787893082.807570:0:5847:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9071073df200:5847] 0 exiting: rc = 1 00000100:00100000:1.0:1787893082.807630:0:8281:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9071102bfe00:8281] 3 exiting: rc = 0 00000100:00100000:1.0:1787893082.807801:0:5849:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff90710df93e00:5849] 2 exiting: rc = 0 00000100:00100000:3.0:1787893082.807858:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.807866:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.807872:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.807877:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.807883:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.807888:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.807893:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.807909:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.807915:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.807919:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.807925:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.807937:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.807942:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.808199:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.808209:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.808215:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.808220:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.808225:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.808231:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.808236:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.808240:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.808245:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.808250:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.808255:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.808259:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.808264:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.808269:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.808274:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.808280:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.808285:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.808290:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.808296:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.808300:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.808306:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.808312:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.808317:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.808322:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.808327:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.808333:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.808339:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.808343:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.808348:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.808360:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.808364:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.808370:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.808375:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.808379:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.808384:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.808390:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.808395:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.808400:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.808404:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.808409:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.808414:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.808419:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.808429:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.809062:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.809067:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.809073:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.809079:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.809085:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.809090:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.809097:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.809102:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.815906:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff90710df93a00:5850] 0 exiting: rc = 1 00000100:00100000:1.0:1787893082.816120:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff90710df92200:5851] 1 exiting: rc = 0 00000100:00100000:3.0:1787893082.816192:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816201:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816208:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816215:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816222:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816234:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816240:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816245:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816251:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816260:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816266:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816271:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816277:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816303:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816307:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816312:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816321:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816326:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816331:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816336:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816340:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816350:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816355:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816360:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816365:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816369:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816380:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816395:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816406:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816412:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816417:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816423:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816428:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816439:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816445:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816450:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816455:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816467:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816473:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816478:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816490:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816497:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816502:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816507:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816518:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816523:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816529:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816534:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816555:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816561:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816573:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816579:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816585:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816607:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816613:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816619:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816624:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816630:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816635:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816641:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816647:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816651:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816657:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.816662:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.817176:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff907105ac4600:5852] 0 exiting: rc = 1 00000100:00100000:0.0:1787893082.820190:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff907105ac5800:5853] 1 exiting: rc = 0 00000100:00100000:2.0:1787893082.820417:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820428:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820448:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820454:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820460:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820478:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820486:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820494:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820502:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820509:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820515:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820523:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820530:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820537:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820544:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820550:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820557:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820580:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820588:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820594:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820600:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820611:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820618:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820624:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820630:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820642:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820652:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820659:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820667:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820691:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820699:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820707:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820714:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820720:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820726:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820732:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820740:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820785:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820791:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820797:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820803:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820826:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820834:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820841:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820848:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820854:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820860:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820867:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820874:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820881:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820887:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820893:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820899:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820922:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820930:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820937:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820944:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820950:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820957:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820964:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820971:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820977:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.820984:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893082.821003:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.840396:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff907105ac4c00:5855] 1 exiting: rc = 0 00000100:00100000:2.0:1787893082.840609:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff907105ac4800:5854] 0 exiting: rc = 1 00000100:00100000:3.0:1787893082.842090:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842100:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842107:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842113:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842119:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842125:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842131:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842136:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842141:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842147:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842152:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842158:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842164:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842169:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842175:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842180:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842185:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842191:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842208:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842214:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842219:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842224:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842229:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842234:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842239:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842244:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842250:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842254:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842260:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842266:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842271:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842277:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842282:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842288:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842293:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842298:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842303:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842309:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842314:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842320:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842325:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842331:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842337:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842342:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842348:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842353:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842360:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842365:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842371:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842376:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842381:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842386:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842391:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842403:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842407:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842412:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842418:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842423:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842428:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842433:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842438:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842442:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842448:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842452:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.842940:0:5857:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff907105a9ba00:5857] 1 exiting: rc = 0 00000100:00100000:3.0:1787893082.843168:0:5856:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff907105ac5e00:5856] 0 exiting: rc = 1 00000100:00100000:3.0:1787893082.843216:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843223:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843229:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843234:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843240:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843246:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843252:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843256:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843262:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843267:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843273:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843279:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843285:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843291:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843296:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843302:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843306:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843311:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843316:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843322:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843328:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843334:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843349:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843355:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843360:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843366:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843371:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843377:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843383:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843388:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843393:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843398:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843404:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843409:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843415:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843421:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843426:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843432:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843438:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843443:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843450:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843456:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843461:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843467:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843473:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843479:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843485:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843490:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843496:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843502:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843508:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843514:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843519:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843524:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843530:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843536:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843540:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843554:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843559:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843564:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843569:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843573:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843579:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.843585:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847071:0:5858:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff907105a9aa00:5858] 0 exiting: rc = 1 00000100:00100000:3.0:1787893082.847223:0:5859:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9071103fdc00:5859] 1 exiting: rc = 0 00000100:00100000:3.0:1787893082.847299:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847306:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847312:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847317:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847323:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847328:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847334:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847340:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847346:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847351:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847356:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847361:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847367:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847372:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847378:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847384:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847389:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847395:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847402:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847408:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847414:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847420:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847426:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847431:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847437:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847442:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847465:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847471:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847477:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847482:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847488:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847494:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847500:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847505:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847511:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847518:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847523:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847528:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847534:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847541:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847547:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847554:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847559:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847564:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847570:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847575:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847580:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847586:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847591:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847596:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847601:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847606:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847612:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847618:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847623:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847629:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847634:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847640:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847645:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847652:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847658:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847670:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847676:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.847682:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.849579:0:5860:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9071065b0a00:5860] 0 exiting: rc = 1 00000100:00100000:3.0:1787893082.849823:0:5862:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff907105798a00:5862] 2 exiting: rc = 0 00000100:00100000:1.0:1787893082.855173:0:5861:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9071065b0600:5861] 1 exiting: rc = 0 00000100:00100000:3.0:1787893082.856043:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856054:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856060:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856067:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856073:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856079:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856085:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856091:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856097:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856122:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856129:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856135:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856140:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856147:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856154:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856159:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856164:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856170:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856176:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856182:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856187:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856192:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856197:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856203:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856208:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856215:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856220:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856226:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856232:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856237:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856254:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856259:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856264:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856287:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856295:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856300:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856307:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856313:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856318:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856326:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856331:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856338:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856345:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856350:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856357:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856375:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856382:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856389:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856395:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856402:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856407:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856414:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856419:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856425:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856434:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856439:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856446:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856452:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856459:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856465:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856472:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856477:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856484:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893082.856499:0:13034:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000001:00100000:0.0:1787893082.861142:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787893082.861152:0:7656:0:(genops.c:885:class_export_put()) final put ffff907139bb1800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787893082.861177:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff907139bb1800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787893082.861218:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff907139bb2800 for lustre-OST0001 00000020:00000080:3.0:1787893082.863060:0:13034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787893082.863087:0:13034:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1787893082.863094:0:13034:0:(genops.c:885:class_export_put()) final put ffff907105af6000/MDS_uuid 00000020:00000080:3.0:1787893082.863098:0:13034:0:(genops.c:844:class_export_destroy()) destroying export ffff907105af6000/MDS_uuid for MDS 00000020:01000000:3.0:1787893082.863109:0:13034:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1787893082.863252:0:13034:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1787893083.219102:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893084.233875:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893085.260683:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787893085.969228:0:6725:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787893085.969238:0:6725:0:(genops.c:885:class_export_put()) final put ffff90712ebd6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787893085.969445:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90712ebd6800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1787893085.969497:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90711b94f800 for lustre-OST0000 00010000:00010000:1.0:1787893086.286093:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787893086.605378:0:13187:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1787893086.630410:0:13187:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1787893086.631709:0:13187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff907104f46e00/0x825e3f5022b4a6b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a6bb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893086.631728:0:13187:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff907104f46e00/0x825e3f5022b4a6b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a6bb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893086.632005:0:13187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff907104f46e00/0x825e3f5022b4a6b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x825e3f5022b4a6bb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893086.632013:0:13187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.129@tcp lock: ffff907104f46e00/0x825e3f5022b4a6b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x825e3f5022b4a6bb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893086.632178:0:13187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787893086.632186:0:13187:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787893086.632215:0:13187:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787893086.632221:0:13187:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787893086.632226:0:13187:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787893086.632253:0:13187:0:(import.c:65:import_set_state_nolock()) ffff90713f77e800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1787893086.632704:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787893086.632712:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff907104f46e00/0x825e3f5022b4a6b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x825e3f5022b4a6bb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893086.632721:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f46e00 already unused, calling callback (ffffffffc1c05c20) 10000000:00010000:0.0:1787893086.632726:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff907104f46e00/0x825e3f5022b4a6b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x825e3f5022b4a6bb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893086.632734:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff907104f46e00/0x825e3f5022b4a6b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x825e3f5022b4a6bb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787893086.632741:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff907104f46e00/0x825e3f5022b4a6b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x825e3f5022b4a6bb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787893086.632747:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787893086.632764:0:5836:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787893086.632767:0:5836:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787893086.632798:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff907104f46e00/0x825e3f5022b4a6b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x825e3f5022b4a6bb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893086.632806:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787893086.632838:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff907104f46e00/0x825e3f5022b4a6b4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x825e3f5022b4a6bb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893086.632845:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff907104f46e00/0x825e3f5022b4a6b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x825e3f5022b4a6bb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893086.632859:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893086.632862:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893086.632864:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893086.632874:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787893086.632896:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700198e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22d910cf-711e-44e0-9acf-212404ada550:3307:1874741455575424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787893086.632974:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893086.633047:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455575424 00000100:00100000:0.0:1787893086.633054:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455575424 00000100:00100000:0.0:1787893086.633105:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787893086.633114:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90700198f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3307:x1874741455575424:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787893086.633121:0:8463:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787893086 with bad export cookie 9394015486153630621 00000100:00100000:3.0:1787893086.633137:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1874741455575296:0@lo:39:umount.0 00000400:00000100:3.0:1787893086.633167:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874741455575296 offset 0 length 224: 4 00000100:00100000:2.0:1787893086.654677:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90700198f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3307:x1874741455575424:12345-0@lo:103:ldlm_bl.0 Request processed in 21548us (21689us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787893086.654697:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1787893086.656504:0:3307:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.129@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787893086.656514:0:3307:0:(import.c:65:import_set_state_nolock()) ffff907105a77800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1787893086.656519:0:3307:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.129@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1787893086.666965:0:3307:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.129@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1787893086.666972:0:3307:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787893086.666983:0:3307:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90700198e300 x1874741455575424/t0(0) o103->MGC192.168.202.129@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787893102 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787893086.667001:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787893086.667004:0:3307:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787893086.667006:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787893086.667010:0:3307:0:(import.c:65:import_set_state_nolock()) ffff907105a77800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787893086.667016:0:3307:0:(import.c:510:import_select_connection()) MGC192.168.202.129@tcp: connect to NID 0@lo last attempt 173 00000100:00080000:0.0:1787893086.667061:0:3307:0:(import.c:624:import_select_connection()) MGC192.168.202.129@tcp: import ffff907105a77800 using connection 192.168.202.129@tcp/0@lo 00000100:00100000:1.0:1787893086.667376:0:3307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9070010cc700 x1874741455575552/t0(0) o250->MGC192.168.202.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787893086.667423:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700198e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:22d910cf-711e-44e0-9acf-212404ada550:3307:1874741455575424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787893086.667489:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:22d910cf-711e-44e0-9acf-212404ada550:3304:1874741455575552:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:2.0:1787893086.667547:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874741455575552 offset 0 length 520: 4 00000100:00100000:3.0:1787893086.924216:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787893086.924250:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874741455575680:0@lo:400:kworker.0 00000400:00000100:3.0:1787893086.924328:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874741455575680 offset 0 length 224: 4 00010000:00010000:1.0:1787893087.305084:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893088.329083:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893089.358532:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893090.379389:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893091.404057:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787893092.042808:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 22d910cf-711e-44e0-9acf-212404ada550->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787893092.042820:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 22d910cf-711e-44e0-9acf-212404ada550->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787893092.042944:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787893092.042964:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700198d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874741455575808:0@lo:400:kworker.0 00000400:00000100:1.0:1787893092.043042:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874741455575808 offset 0 length 224: 4 00010000:00010000:0.0:1787893092.431029:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893093.449373:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893094.473894:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893095.498221:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893096.138128:0:3304:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787893086/real 1787893086] req@ffff9070010cc700 x1874741455575552/t0(0) o250->MGC192.168.202.129@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787893096 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893096.138160:0:3304:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9070010cc700 x1874741455575552/t0(0) o250->MGC192.168.202.129@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787893096 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893096.138171:0:3304:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787893086/real 1787893086] req@ffff90712e628e00 x1874741455575296/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787893096 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893096.138184:0:3304:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90712e628e00 x1874741455575296/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787893096 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787893096.138221:0:3304:0:(import.c:65:import_set_state_nolock()) ffff907105a77800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787893096.138244:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1787893096.138249:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:22d910cf-711e-44e0-9acf-212404ada550:3304:1874741455575552:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:2.0:1787893096.138255:0:3304:0:(import.c:65:import_set_state_nolock()) ffff90713f77e800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787893096.138272:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1874741455575296:0@lo:39:umount.0 00000100:00080000:1.0:1787893096.138342:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 22d910cf-711e-44e0-9acf-212404ada550->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787893096.138348:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1787893096.138350:0:37:0:(import.c:65:import_set_state_nolock()) ffff907105a77800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787893096.138356:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.129@tcp: connect to NID 0@lo last attempt 414 00000100:00080000:1.0:1787893096.138362:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.129@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787893096.138368:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.129@tcp: import ffff907105a77800 using connection 192.168.202.129@tcp/0@lo 00000100:00080000:3.0:1787893096.138372:0:13187:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787893096.138377:0:13187:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787893096.138381:0:13187:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1787893096.138397:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9070010cc700 x1874741455575936/t0(0) o250->MGC192.168.202.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787893096.138488:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787893096.138512:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874741455576064:0@lo:400:kworker.0 00000400:00000100:1.0:1787893096.138570:0:3308:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874741455576064 offset 0 length 224: 4 00000100:00100000:2.0:1787893096.138799:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:22d910cf-711e-44e0-9acf-212404ada550:3304:1874741455575936:0@lo:250:kworker.0 00000400:00000100:2.0:1787893096.138823:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874741455575936 offset 0 length 520: 4 00010000:00010000:3.0:1787893096.139626:0:13187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9071102b9400/0x825e3f5022b4a6c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a6c9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893096.139641:0:13187:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9071102b9400/0x825e3f5022b4a6c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a6c9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893096.139648:0:13187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9071102b9400/0x825e3f5022b4a6c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x825e3f5022b4a6c9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893096.139655:0:13187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.129@tcp lock: ffff9071102b9400/0x825e3f5022b4a6c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x825e3f5022b4a6c9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893096.139679:0:13187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787893096.139686:0:13187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff907104f47000/0x825e3f5022b4a8f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a900 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893096.139708:0:13187:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff907104f47000/0x825e3f5022b4a8f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a900 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893096.139714:0:13187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff907104f47000/0x825e3f5022b4a8f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x825e3f5022b4a900 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893096.139720:0:13187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.129@tcp lock: ffff907104f47000/0x825e3f5022b4a8f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x825e3f5022b4a900 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893096.139734:0:13187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1787893096.139740:0:13187:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1787893096.139792:0:13187:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1787893096.139796:0:13187:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1787893096.139801:0:13187:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787893096.139807:0:13187:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787893096.139811:0:13187:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff907105a899b8) has no exports 00000020:00080000:3.0:1787893096.139836:0:13187:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff907105a899b8) has no exports 00010000:00010000:1.0:1787893096.141617:0:7644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787893096.141631:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9071102b9400/0x825e3f5022b4a6c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x825e3f5022b4a6c9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893096.141643:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071102b9400 already unused, calling callback (ffffffffc1c05c20) 10000000:00010000:1.0:1787893096.141647:0:7644:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9071102b9400/0x825e3f5022b4a6c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x825e3f5022b4a6c9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893096.141659:0:7644:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9071102b9400/0x825e3f5022b4a6c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x825e3f5022b4a6c9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787893096.141666:0:7644:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9071102b9400/0x825e3f5022b4a6c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x825e3f5022b4a6c9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893096.141693:0:7644:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787893096.141696:0:7644:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1787893096.141699:0:7644:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1787893096.141716:0:7644:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff907105a77800 00010000:00010000:1.0:1787893096.141720:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9071102b9400/0x825e3f5022b4a6c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x825e3f5022b4a6c9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893096.141726:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9071102b9400/0x825e3f5022b4a6c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x825e3f5022b4a6c9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893096.141743:0:7644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893096.141747:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff907104f47000/0x825e3f5022b4a8f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x825e3f5022b4a900 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893096.141784:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f47000 already unused, calling callback (ffffffffc1c05c20) 10000000:00010000:1.0:1787893096.141788:0:7644:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff907104f47000/0x825e3f5022b4a8f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x825e3f5022b4a900 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893096.141794:0:7644:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff907104f47000/0x825e3f5022b4a8f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x825e3f5022b4a900 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787893096.141799:0:7644:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff907104f47000/0x825e3f5022b4a8f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x825e3f5022b4a900 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893096.141804:0:7644:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787893096.141806:0:7644:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787893096.141808:0:7644:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787893096.141813:0:7644:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff907105a77800 00010000:00010000:1.0:1787893096.141816:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff907104f47000/0x825e3f5022b4a8f9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x825e3f5022b4a900 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893096.141913:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff907104f47000/0x825e3f5022b4a8f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x825e3f5022b4a900 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893096.141925:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893096.141927:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893096.141929:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893096.141936:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1787893096.151321:0:13187:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff907137ff1cc0 - data ffff90710e3a4e58/ffff907137fd0800 00000020:01000000:3.0:1787893096.151444:0:13187:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9071073278a0 - data ffff90710e326a20/ffff90713f72c400 00100000:10000000:3.0:1787893096.161965:0:13187:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787893096.206800:0:13187:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x825e3f5022b4a4d1 00000020:00000080:3.0:1787893096.206813:0:13187:0:(genops.c:885:class_export_put()) final put ffff90713ac86800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1787893096.206839:0:13187:0:(tgt_mount.c:187:server_put_mount()) put mount ffff907105af0000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1787893096.206856:0:13187:0:(obd_mount.c:710:lustre_put_lsi()) put ffff907105af0000 2 00000020:01000004:3.0:1787893096.206860:0:13187:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff907105af0000 from lustre-OST0000 00000020:00000080:3.0:1787893096.206895:0:13187:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787893096.206905:0:13187:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1787893096.206909:0:13187:0:(genops.c:885:class_export_put()) final put ffff90713ac80000/lustre-OST0000_UUID 00000020:00000080:3.0:1787893096.206940:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff90713ac80000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1787893096.206968:0:13187:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1787893096.207013:0:13187:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1787893096.207017:0:13187:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1787893096.207022:0:13187:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787893096.207028:0:13187:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787893096.207035:0:13187:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff90713f77c800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787893096.207043:0:13187:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff90711badb370) has exports, disconnecting them 00000020:00080000:3.0:1787893096.207047:0:13187:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff90713f77c800), last request at 1787892863 00000020:00000080:3.0:1787893096.207051:0:13187:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x825e3f5022b4a4fb 00000020:00080000:3.0:1787893096.207062:0:13187:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff90713f77c800): rc 0 00000020:00000080:3.0:1787893096.207066:0:13187:0:(genops.c:885:class_export_put()) final put ffff90713f77c800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787893096.207777:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90713ac86800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787893096.207792:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90713f77c800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1787893096.208209:0:13187:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787893096.208214:0:13187:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787893096.208218:0:13187:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787893096.208224:0:13187:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787893096.208366:0:13187:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787893096.208372:0:13187:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1787893096.208378:0:13187:0:(obd_mount.c:710:lustre_put_lsi()) put ffff907105af0000 1 00000020:00000080:0.0:1787893096.208382:0:13187:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x825e3f5022b4a48b 00000020:00000080:0.0:1787893096.208387:0:13187:0:(genops.c:885:class_export_put()) final put ffff90713788a800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1787893096.208392:0:13187:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1787893096.208396:0:13187:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787893096.208400:0:13187:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787893096.208402:0:13187:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff907105a8cd28) has no exports 00000020:00000080:1.0:1787893096.208486:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90713f77e800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787893096.208492:0:37:0:(genops.c:885:class_export_put()) final put ffff90710df99000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1787893096.208495:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90710df99000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1787893096.208499:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1787893096.208542:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90713788a800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787893096.234674:0:13187:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787893096.234691:0:13187:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1787893096.234698:0:13187:0:(genops.c:885:class_export_put()) final put ffff90712e2df800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1787893096.234703:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff90712e2df800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1787893096.234710:0:13187:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1787893096.234901:0:13187:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90712e2db800 00000020:02000400:0.0:1787893096.234949:0:13187:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1787893096.520996:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893097.545552:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893098.570966:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787893098.809231:0:13340:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1787893098.824143:0:13340:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1787893098.824223:0:13340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff907104f46600/0x825e3f5022b4a698 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a69f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893098.824238:0:13340:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff907104f46600/0x825e3f5022b4a698 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a69f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893098.824246:0:13340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff907104f46600/0x825e3f5022b4a698 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x825e3f5022b4a69f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893098.824252:0:13340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.129@tcp lock: ffff907104f46600/0x825e3f5022b4a698 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x825e3f5022b4a69f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893098.824283:0:13340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787893098.824288:0:13340:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787893098.824323:0:13340:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:2.0:1787893098.824412:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787893098.824419:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff907104f46600/0x825e3f5022b4a698 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x825e3f5022b4a69f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893098.824426:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f46600 already unused, calling callback (ffffffffc1c05c20) 10000000:00010000:2.0:1787893098.824430:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff907104f46600/0x825e3f5022b4a698 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x825e3f5022b4a69f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893098.824439:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff907104f46600/0x825e3f5022b4a698 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x825e3f5022b4a69f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787893098.824446:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff907104f46600/0x825e3f5022b4a698 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x825e3f5022b4a69f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787893098.824452:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787893098.824455:0:5836:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787893098.824457:0:5836:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787893098.824470:0:5836:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff907105a77800 00010000:00010000:2.0:1787893098.824473:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff907104f46600/0x825e3f5022b4a698 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x825e3f5022b4a69f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893098.824492:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff907104f46600/0x825e3f5022b4a698 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x825e3f5022b4a69f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893098.824504:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893098.824506:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893098.824508:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893098.824540:0:13340:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9070010ced80 x1874741455575680/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893102 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893098.824568:0:13340:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff90700198d880 x1874741455575808/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893108 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893098.824584:0:13340:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9070010cce00 x1874741455576064/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893112 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893098.824597:0:13340:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787893098.824603:0:13340:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787893098.824627:0:13340:0:(import.c:65:import_set_state_nolock()) ffff90713788a000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787893098.824698:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1874741455575680:0@lo:400:kworker.0 00000100:00100000:2.0:1787893098.824730:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1874741455576192:0@lo:39:umount.0 00000400:00000100:2.0:1787893098.824817:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874741455576192 offset 0 length 224: 4 00000100:00100000:1.0:1787893098.825921:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700198d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874741455575808:0@lo:400:kworker.0 00000100:00100000:1.0:1787893098.825953:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874741455576064:0@lo:400:kworker.0 00010000:00010000:1.0:1787893099.594597:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893100.617976:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787893101.257142:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 22d910cf-711e-44e0-9acf-212404ada550->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787893101.257153:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 22d910cf-711e-44e0-9acf-212404ada550->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1787893101.640954:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893102.664944:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893103.689176:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893104.713066:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893105.737069:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787893106.377484:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 22d910cf-711e-44e0-9acf-212404ada550->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787893106.377499:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 22d910cf-711e-44e0-9acf-212404ada550->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1787893106.761049:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893107.784930:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893108.809005:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893109.000940:0:3304:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787893098/real 1787893098] req@ffff9070038c0380 x1874741455576192/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787893108 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893109.001167:0:3304:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9070038c0380 x1874741455576192/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787893108 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787893109.001187:0:3304:0:(import.c:65:import_set_state_nolock()) ffff90713788a000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787893109.001207:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1874741455576192:0@lo:39:umount.0 00000100:00080000:3.0:1787893109.001304:0:13340:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787893109.001310:0:13340:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787893109.001315:0:13340:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787893109.004805:0:13340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff907103f06c00/0x825e3f5022b4a6a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a6ad expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893109.004826:0:13340:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff907103f06c00/0x825e3f5022b4a6a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a6ad expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893109.004835:0:13340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff907103f06c00/0x825e3f5022b4a6a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x825e3f5022b4a6ad expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893109.005097:0:13340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.129@tcp lock: ffff907103f06c00/0x825e3f5022b4a6a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x825e3f5022b4a6ad expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893109.005191:0:13340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787893109.005200:0:13340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9071102b8200/0x825e3f5022b4a8eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4a8f2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893109.005227:0:13340:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9071102b8200/0x825e3f5022b4a8eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4a8f2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893109.005233:0:13340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9071102b8200/0x825e3f5022b4a8eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x825e3f5022b4a8f2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893109.005239:0:13340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.129@tcp lock: ffff9071102b8200/0x825e3f5022b4a8eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x825e3f5022b4a8f2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893109.008195:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787893109.008225:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff907103f06c00/0x825e3f5022b4a6a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x825e3f5022b4a6ad expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893109.008237:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907103f06c00 already unused, calling callback (ffffffffc1c05c20) 10000000:00010000:1.0:1787893109.008241:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff907103f06c00/0x825e3f5022b4a6a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x825e3f5022b4a6ad expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893109.008252:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff907103f06c00/0x825e3f5022b4a6a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x825e3f5022b4a6ad expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787893109.008260:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff907103f06c00/0x825e3f5022b4a6a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x825e3f5022b4a6ad expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893109.008266:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787893109.008269:0:5837:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1787893109.008282:0:5837:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff907105a77800 00010000:00010000:1.0:1787893109.008286:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff907103f06c00/0x825e3f5022b4a6a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x825e3f5022b4a6ad expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893109.008293:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff907103f06c00/0x825e3f5022b4a6a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x825e3f5022b4a6ad expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893109.008312:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893109.008316:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9071102b8200/0x825e3f5022b4a8eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x825e3f5022b4a8f2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893109.008322:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071102b8200 already unused, calling callback (ffffffffc1c05c20) 10000000:00010000:1.0:1787893109.008325:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9071102b8200/0x825e3f5022b4a8eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x825e3f5022b4a8f2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893109.008331:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9071102b8200/0x825e3f5022b4a8eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x825e3f5022b4a8f2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787893109.008344:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9071102b8200/0x825e3f5022b4a8eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x825e3f5022b4a8f2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893109.008349:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787893109.008351:0:5837:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1787893109.008356:0:5837:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff907105a77800 00010000:00010000:1.0:1787893109.008358:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9071102b8200/0x825e3f5022b4a8eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x825e3f5022b4a8f2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893109.008364:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893109.008380:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893109.008383:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893109.008636:0:13340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787893109.008645:0:13340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9071102b8200/0x825e3f5022b4a8eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x825e3f5022b4a8f2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787893109.008661:0:13340:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1787893109.008668:0:13340:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1787893109.008669:0:13340:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1787893109.008702:0:13340:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1787893109.008706:0:13340:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1787893109.008712:0:13340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787893109.008718:0:13340:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787893109.008722:0:13340:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff90712ea78000) has no exports 00000020:00080000:3.0:1787893109.008854:0:13340:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff90712ea78000) has no exports 00000020:01000000:3.0:1787893109.010591:0:13340:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff907137ff1a20 - data ffff90713fdba0d8/ffff907137bc4400 00000020:01000000:3.0:1787893109.010811:0:13340:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90713f994a80 - data ffff90713fd94e58/ffff907139bbb400 00010000:00010000:2.0:1787893109.012142:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1787893109.024158:0:13340:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787893109.042540:0:13340:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x825e3f5022b4a59c 00000020:00000080:2.0:1787893109.042550:0:13340:0:(genops.c:885:class_export_put()) final put ffff907139bb4000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1787893109.042600:0:13340:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9071072cc000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1787893109.042614:0:13340:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9071072cc000 2 00000020:01000004:2.0:1787893109.042617:0:13340:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9071072cc000 from lustre-OST0001 00000020:00000080:2.0:1787893109.042643:0:13340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787893109.042654:0:13340:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1787893109.042657:0:13340:0:(genops.c:885:class_export_put()) final put ffff907139bb7800/lustre-OST0001_UUID 00000020:00000080:2.0:1787893109.042660:0:13340:0:(genops.c:844:class_export_destroy()) destroying export ffff907139bb7800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1787893109.042666:0:13340:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1787893109.042833:0:13340:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 22d910cf-711e-44e0-9acf-212404ada550->MGS 00010000:00010000:2.0:1787893109.042848:0:13340:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff90710153b400/0x825e3f5022b4a4ae lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x825e3f5022b4a4b5 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787893109.042860:0:13340:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff90710153b400/0x825e3f5022b4a4ae lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x825e3f5022b4a4b5 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787893109.042866:0:13340:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1787893109.042869:0:13340:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1787893109.042872:0:13340:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1787893109.042970:0:13340:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff907105a77800 00010000:00010000:2.0:1787893109.042975:0:13340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff90710153b400/0x825e3f5022b4a4ae lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x825e3f5022b4a4b5 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893109.042990:0:13340:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff907103f07400/0x825e3f5022b4a6ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x825e3f5022b4a6f3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787893109.042996:0:13340:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff907103f07400/0x825e3f5022b4a6ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x825e3f5022b4a6f3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787893109.043002:0:13340:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787893109.043005:0:13340:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1787893109.043006:0:13340:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1787893109.043017:0:13340:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff907105a77800 00010000:00010000:2.0:1787893109.043020:0:13340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff907103f07400/0x825e3f5022b4a6ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x825e3f5022b4a6f3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787893109.043044:0:13340:0:(import.c:65:import_set_state_nolock()) ffff907105a77800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1787893109.043048:0:13340:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787893109.043050:0:13340:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787893109.043051:0:13340:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1787893109.043055:0:13340:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787893109.043066:0:13340:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9070010cc700 x1874741455575936/t0(0) o250->MGC192.168.202.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787893111 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787893109.043093:0:13340:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787893109.043096:0:13340:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:1.0:1787893109.043192:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:22d910cf-711e-44e0-9acf-212404ada550:3304:1874741455575936:0@lo:250:kworker.0 10000000:01000000:2.0:1787893109.043313:0:13340:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787893109.043319:0:13340:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x825e3f5022b4a38f 00000020:00000080:2.0:1787893109.043322:0:13340:0:(genops.c:885:class_export_put()) final put ffff907105af3800/22d910cf-711e-44e0-9acf-212404ada550 00000020:00000080:3.0:1787893109.043358:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff907139bb4000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1787893109.043478:0:13340:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.129@tcp (flags='') 00000020:00000080:2.0:1787893109.043484:0:13340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787893109.043487:0:13340:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.129@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787893109.043490:0:13340:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff907105a88000) has no exports 10000000:01000000:1.0:1787893109.043551:0:5846:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1787893109.045922:0:13340:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.129@tcp: client import never connected 00000100:00080000:2.0:1787893109.045933:0:13340:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1787893109.045937:0:13340:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787893109.045941:0:13340:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1787893109.045943:0:13340:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787893109.045997:0:13340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787893109.046005:0:13340:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.129@tcp (uuid 22d910cf-711e-44e0-9acf-212404ada550) 00000020:01000000:2.0:1787893109.046012:0:13340:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1787893109.046024:0:13340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787893109.046032:0:13340:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787893109.046039:0:13340:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9071184b4000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787893109.046044:0:13340:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff907105a8b370) has exports, disconnecting them 00000020:00080000:2.0:1787893109.046049:0:13340:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9071184b4000), last request at 1787892882 00000020:00000080:2.0:1787893109.046054:0:13340:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x825e3f5022b4a5c6 00000020:00080000:2.0:1787893109.046083:0:13340:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9071184b4000): rc 0 00000020:00000080:2.0:1787893109.046088:0:13340:0:(genops.c:885:class_export_put()) final put ffff9071184b4000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1787893109.046532:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff907105af3800/22d910cf-711e-44e0-9acf-212404ada550 for MGC192.168.202.129@tcp 00000020:00000080:3.0:1787893109.046544:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff907105a77800 for MGC192.168.202.129@tcp 00000020:00000080:3.0:1787893109.046556:0:36:0:(genops.c:885:class_export_put()) final put ffff907105a74800/22d910cf-711e-44e0-9acf-212404ada550 00000020:00000080:3.0:1787893109.046559:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff907105a74800/22d910cf-711e-44e0-9acf-212404ada550 for MGC192.168.202.129@tcp 00000020:01000000:3.0:1787893109.046563:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.129@tcp (22d910cf-711e-44e0-9acf-212404ada550) 00000020:00000080:3.0:1787893109.047994:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9071184b4000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1787893109.048811:0:13340:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1787893109.048818:0:13340:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787893109.048821:0:13340:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787893109.048827:0:13340:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787893109.048896:0:7644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1787893109.049018:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000020:00000080:1.0:1787893109.049184:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff90713788a000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:3.0:1787893109.050814:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1787893109.050975:0:5831:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff90712c45ac00:5831] 0 exiting: rc = 1 00000100:00100000:1.0:1787893109.051141:0:8462:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9071102bea00:8462] 2 exiting: rc = 0 00000100:00100000:2.0:1787893109.058554:0:5832:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9071055d0000:5832] 1 exiting: rc = 0 00000100:00100000:3.0:1787893109.058774:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.059317:0:5835:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff90710736ba00:5835] 2 exiting: rc = 0 00000100:00100000:2.0:1787893109.059393:0:8463:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff907139bbc200:8463] 3 exiting: rc = 0 00000100:00100000:1.0:1787893109.059480:0:5834:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9071298b9400:5834] 1 exiting: rc = 0 00000100:00100000:2.0:1787893109.059843:0:5833:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9071298b8800:5833] 0 exiting: rc = 1 00000100:00100000:3.0:1787893109.059982:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.059990:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.059997:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060004:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060010:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060015:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060021:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060027:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060033:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060039:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060046:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060052:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060058:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060064:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060070:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060079:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060085:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060090:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060096:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060115:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060121:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060127:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060132:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060138:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060143:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060148:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060153:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060158:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060163:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060168:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060174:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060179:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060184:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060189:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060195:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060204:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060209:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060214:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060219:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060224:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060229:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060235:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060240:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060245:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060250:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060255:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060272:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060278:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060283:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060287:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060293:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060298:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060303:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060307:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060320:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060325:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060330:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060335:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060340:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060345:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060350:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060354:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060359:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.060364:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787893109.061593:0:13340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787893109.061606:0:13340:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1787893109.061613:0:13340:0:(genops.c:885:class_export_put()) final put ffff90713ac81000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1787893109.061618:0:13340:0:(genops.c:844:class_export_destroy()) destroying export ffff90713ac81000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1787893109.061634:0:13340:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1787893109.061676:0:13340:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9071072cc000 1 00000020:00000080:3.0:1787893109.061682:0:13340:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x825e3f5022b4a56b 00000020:00000080:3.0:1787893109.061689:0:13340:0:(genops.c:885:class_export_put()) final put ffff9071072cf800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1787893109.061739:0:13340:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1787893109.061784:0:13340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787893109.061790:0:13340:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787893109.061794:0:13340:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff90712ea7b370) has no exports 00000020:00000080:1.0:1787893109.062350:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9071072cf800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1787893109.086651:0:13340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787893109.086668:0:13340:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1787893109.086674:0:13340:0:(genops.c:885:class_export_put()) final put ffff9071072cb800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1787893109.086679:0:13340:0:(genops.c:844:class_export_destroy()) destroying export ffff9071072cb800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1787893109.086702:0:13340:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1787893109.086910:0:13340:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9071072cc800 00000020:01000000:0.0:1787893109.086932:0:13340:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1787893109.086937:0:13340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787893109.086941:0:13340:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787893109.086945:0:13340:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff90710734cd28) has no exports 00000020:00000080:0.0:1787893109.086987:0:13340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787893109.086993:0:13340:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1787893109.086996:0:13340:0:(genops.c:885:class_export_put()) final put ffff90713788c800/OSS_uuid 00000020:00000080:0.0:1787893109.086998:0:13340:0:(genops.c:844:class_export_destroy()) destroying export ffff90713788c800/OSS_uuid for OSS 00000020:01000000:0.0:1787893109.087002:0:13340:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1787893109.087079:0:6701:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9071064b3400:6701] 1 exiting: rc = 0 00000100:00100000:3.0:1787893109.087238:0:6700:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff907108c10000:6700] 0 exiting: rc = 1 00000100:00080000:2.0:1787893109.087677:0:5844:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1787893109.089171:0:8105:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff907107e86e00:8105] 3 exiting: rc = 0 00000100:00100000:0.0:1787893109.089819:0:6702:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9071064b3a00:6702] 2 exiting: rc = 0 00000100:00100000:3.0:1787893109.089936:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.089945:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.089952:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.089973:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.089979:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.089985:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.089990:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.089997:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090002:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090008:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090027:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090032:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090037:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090043:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090049:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090055:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090060:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090066:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090071:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090076:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090081:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090086:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090092:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090097:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090102:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090107:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090112:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090117:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090122:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090127:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090132:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090137:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090143:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090148:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090153:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090158:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090163:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090168:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090173:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090178:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090183:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090188:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090194:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090199:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090203:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090215:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090220:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090225:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090230:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090235:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090240:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090245:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090250:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090255:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090259:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090264:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090268:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090273:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090278:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090284:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090289:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090294:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090299:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.090311:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.092561:0:6704:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff90713acbbc00:6704] 1 exiting: rc = 0 00000100:00100000:3.0:1787893109.092607:0:6703:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9071064b2c00:6703] 0 exiting: rc = 1 00000100:00100000:2.0:1787893109.092672:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.092682:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.092688:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.092694:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.092699:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.092705:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.092711:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.092716:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.092722:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.092728:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.092733:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.092739:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.092772:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.092780:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.092786:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.092792:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.092797:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.092803:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.092812:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.092818:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.092824:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.092829:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.092834:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.092840:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.092845:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.092866:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.092871:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.092876:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.092883:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.092888:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.092894:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.092900:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.092905:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.092909:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.092915:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.092920:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.092928:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.092935:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.092942:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.092948:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.092952:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.092957:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.092972:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.092979:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.092985:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.092990:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.092996:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.093002:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.093007:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.093012:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.093017:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.093023:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.093029:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.093035:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.093041:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.093047:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.093052:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.093057:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.093062:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.093067:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.093080:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.093085:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.093090:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.093095:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.093961:0:6706:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff90711176dc00:6706] 1 exiting: rc = 0 00000100:00100000:2.0:1787893109.094121:0:6707:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9071064b1200:6707] 2 exiting: rc = 0 00000100:00100000:3.0:1787893109.095047:0:6705:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff90711176c200:6705] 0 exiting: rc = 1 00000100:00100000:2.0:1787893109.095872:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.095880:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.095885:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.095894:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.095900:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.095906:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.095912:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.095918:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.095923:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.095928:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.095934:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.095940:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.095946:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.095951:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.095958:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.096235:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.096241:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.096247:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.096253:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.096259:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.096278:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.096285:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.096291:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.096296:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.096301:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.096307:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.096313:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.096319:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.096325:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.096346:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.096351:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.096357:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.096362:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.096368:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.096374:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.096381:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.096387:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.096393:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.096399:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.096475:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.096485:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.096490:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.096496:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.096502:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.096527:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.096535:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.096540:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.096545:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.096550:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.096555:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.096561:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.096566:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.096573:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.096579:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.096585:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.096591:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.096598:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.096603:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.096609:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.096615:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.096622:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.096628:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.096634:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.096640:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.104644:0:6708:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff907108c11400:6708] 0 exiting: rc = 1 00000100:00100000:1.0:1787893109.105069:0:6709:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff90713accbe00:6709] 1 exiting: rc = 0 00000100:00100000:2.0:1787893109.105200:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105208:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105213:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105218:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105224:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105230:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105235:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105241:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105246:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105252:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105257:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105262:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105266:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105271:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105276:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105281:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105287:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105292:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105297:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105303:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105308:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105313:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105318:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105323:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105328:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105334:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105339:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105345:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105350:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105355:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105360:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105365:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105481:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105486:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105491:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105514:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105520:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105525:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105530:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105535:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105541:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105547:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105553:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105558:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105563:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105569:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105575:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105580:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105587:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105592:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105597:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105602:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105608:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105614:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105619:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105624:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105629:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105635:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105640:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105645:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105651:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105656:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105661:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787893109.105676:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787893109.108135:0:6710:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9071064bf000:6710] 0 exiting: rc = 1 00000100:00100000:0.0:1787893109.108320:0:6711:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff90713f35d800:6711] 1 exiting: rc = 0 00000100:00100000:3.0:1787893109.108610:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.108639:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.108647:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.108652:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.108658:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.108663:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.108668:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.108673:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.108680:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.108685:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.108690:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.108696:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.109677:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.109704:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.109863:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.109871:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.109877:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.109883:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.111131:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.111139:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.111145:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.111153:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.111161:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.111168:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.111174:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.111206:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.111212:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.111218:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.111225:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.111231:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.111236:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.111242:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.111249:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.111256:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.111263:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.111268:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.111274:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.111293:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.111300:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.111307:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.111313:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.111318:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.111322:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.111326:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.111330:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.111335:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.111338:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.111354:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.111358:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.111371:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.111375:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.111380:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.111383:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.111388:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.111391:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.111395:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.111399:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.111403:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.111407:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.111411:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.111415:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.111419:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.111423:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787893109.111428:0:13340:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1787893109.148906:0:13340:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1787893127.945138:0:13957:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg229-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787893137.551986:0:14418:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787893137.551992:0:14418:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1787893137.552110:0:14418:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9071087e7000 00000020:01000004:2.0:1787893137.552127:0:14418:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787893137.552136:0:14418:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787893137.552164:0:14418:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff90711bad8000) 00000020:00000080:2.0:1787893137.552179:0:14418:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787893137.572364:0:14418:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787893137.574063:0:14418:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1787893137.574401:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:2.0:1787893137.574479:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:2.0:1787893137.578725:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:2.0:1787893137.579040:0:14418:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787893137.579115:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:2.0:1787893137.580730:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:2.0:1787893137.580977:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:2.0:1787893137.581275:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:2.0:1787893137.584735:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 359: rc = 0 00100000:10000000:2.0:1787893137.584883:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 359: rc = 0 00100000:10000000:2.0:1787893137.585302:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 641: rc = 0 00100000:10000000:2.0:1787893137.585837:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 641: rc = 0 00100000:10000000:2.0:1787893137.586260:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 641: rc = 0 00100000:10000000:2.0:1787893137.586667:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 641: rc = 0 00100000:10000000:2.0:1787893137.587132:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 641: rc = 0 00100000:10000000:2.0:1787893137.587976:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 641: rc = 0 00100000:10000000:2.0:1787893137.588264:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 641: rc = 0 00100000:10000000:2.0:1787893137.588673:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 641: rc = 0 00100000:10000000:3.0:1787893137.590884:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 641: rc = 0 00100000:10000000:3.0:1787893137.591148:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 641: rc = 0 00100000:10000000:3.0:1787893137.592843:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 641: rc = 0 00100000:10000000:3.0:1787893137.593169:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 641: rc = 0 00100000:10000000:3.0:1787893137.595173:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 373: rc = 0 00100000:10000000:3.0:1787893137.596974:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 373: rc = 0 00100000:10000000:3.0:1787893137.597274:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 373: rc = 0 00100000:10000000:3.0:1787893137.598988:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 373: rc = 0 00100000:10000000:3.0:1787893137.599262:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 373: rc = 0 00100000:10000000:3.0:1787893137.601051:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 373: rc = 0 00100000:10000000:3.0:1787893137.601358:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 373: rc = 0 00100000:10000000:3.0:1787893137.602860:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 373: rc = 0 00100000:10000000:3.0:1787893137.603182:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 373: rc = 0 00100000:10000000:3.0:1787893137.603435:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 373: rc = 0 00100000:10000000:3.0:1787893137.604741:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 373: rc = 0 00100000:10000000:3.0:1787893137.605025:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 373: rc = 0 00100000:10000000:3.0:1787893137.605280:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 373: rc = 0 00100000:10000000:3.0:1787893137.605945:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 373: rc = 0 00100000:10000000:3.0:1787893137.606591:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 373: rc = 0 00100000:10000000:3.0:1787893137.606958:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 373: rc = 0 00100000:10000000:3.0:1787893137.607218:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 373: rc = 0 00100000:10000000:3.0:1787893137.607941:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 373: rc = 0 00100000:10000000:3.0:1787893137.608216:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 373: rc = 0 00100000:10000000:3.0:1787893137.608559:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 373: rc = 0 00100000:10000000:3.0:1787893137.610673:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 373: rc = 0 00100000:10000000:3.0:1787893137.611002:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 373: rc = 0 00100000:10000000:3.0:1787893137.611257:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 373: rc = 0 00100000:10000000:3.0:1787893137.612599:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 373: rc = 0 00100000:10000000:3.0:1787893137.612902:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 373: rc = 0 00100000:10000000:3.0:1787893137.613537:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 373: rc = 0 00100000:10000000:3.0:1787893137.613855:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 373: rc = 0 00100000:10000000:3.0:1787893137.614105:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 373: rc = 0 00100000:10000000:3.0:1787893137.614353:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 373: rc = 0 00100000:10000000:3.0:1787893137.614875:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 373: rc = 0 00100000:10000000:3.0:1787893137.615362:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 373: rc = 0 00100000:10000000:3.0:1787893137.615625:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 373: rc = 0 00100000:10000000:3.0:1787893137.616335:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 655: rc = 0 00100000:10000000:3.0:1787893137.619970:0:14418:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1787893137.620160:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 360: rc = 0 00100000:10000000:3.0:1787893137.620656:0:14418:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1787893137.620734:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 360: rc = 0 00100000:10000000:3.0:1787893137.621030:0:14418:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1787893137.621102:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 360: rc = 0 00100000:10000000:3.0:1787893137.622870:0:14418:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1787893137.622974:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 509: rc = 0 00100000:10000000:3.0:1787893137.623211:0:14418:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1787893137.623280:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 509: rc = 0 00100000:10000000:3.0:1787893137.626194:0:14418:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1787893137.626301:0:14418:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 509: rc = 0 00000020:00000080:3.0:1787893137.632372:0:14418:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787893137.632385:0:14418:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787893137.632397:0:14418:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x825e3f5022b4b690 00000020:01000004:3.0:1787893137.632406:0:14418:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1787893137.632411:0:14418:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787893137.632417:0:14418:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9071087e7000 from MGS 00000020:01000004:3.0:1787893137.632421:0:14418:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787893137.632434:0:14418:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff90712ea7cd28) 00000020:00000080:3.0:1787893137.632443:0:14418:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787893137.632523:0:14418:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9071087e7000 from MGS, refs=2 00080000:01000000:3.0:1787893137.632528:0:14418:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787893137.632533:0:14418:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x825e3f5022b4b69e 00000100:00100000:3.0:1787893137.632657:0:14418:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787893137.633009:0:14418:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787893137.633016:0:14418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787893137.651029:0:14418:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787893137.651050:0:14418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787893137.652108:0:14418:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787893137.652313:0:14418:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787893137.652318:0:14418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787893137.653668:0:14418:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787893137.653689:0:14418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787893137.654548:0:14418:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787893137.654558:0:14418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787893137.656744:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893137.656773:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893137.656775:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893137.657166:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893137.657169:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893137.657171:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893137.657904:0:14418:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787893137.665551:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787893137.679463:0:14418:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1787893137.679493:0:14418:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787893137.679497:0:14418:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1787893137.689514:0:14429:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787893137.689813:0:14418:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787893137.689957:0:14418:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787893137.690521:0:14418:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787893137.690862:0:14418:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787893137.691057:0:14418:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787893137.691064:0:14418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787893137.695420:0:14418:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787893137.695442:0:14418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787893137.696959:0:14418:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787893137.696971:0:14418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787893137.697711:0:14418:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787893137.697738:0:14418:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.129@tcp' 00000020:01000004:0.0:1787893137.697740:0:14418:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787893137.697800:0:14418:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.129@tcp (typ=mgc) 00000020:00000080:0.0:1787893137.697814:0:14418:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.129@tcp (ffff907105a8cd28) 00000020:00000080:0.0:1787893137.697843:0:14418:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787893137.697932:0:14418:0:(ldlm_lib.c:102:import_set_conn()) imp ffff907139e73000@MGC192.168.202.129@tcp: add connection 192.168.202.129@tcp at head 00010000:00010000:0.0:1787893137.698461:0:14418:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.129@tcp-0 is initialized 00000040:01000000:0.0:1787893137.698468:0:14418:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.129@tcp ctxt 1 is initialized 00000100:00080000:3.0:1787893137.698718:0:14433:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1787893137.700786:0:14434:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1787893137.700925:0:14418:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.129@tcp (uuid f31ac154-369d-4473-bca1-5cb1596e1d9c) 00000020:00000080:0.0:1787893137.700950:0:14418:0:(genops.c:1385:class_connect()) connect: client f31ac154-369d-4473-bca1-5cb1596e1d9c, cookie 0x825e3f5022b4b6ac 00000100:00080000:0.0:1787893137.700967:0:14418:0:(import.c:510:import_select_connection()) MGC192.168.202.129@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787893137.700975:0:14418:0:(import.c:624:import_select_connection()) MGC192.168.202.129@tcp: import ffff907139e73000 using connection 192.168.202.129@tcp/0@lo 00000100:00100000:0.0:1787893137.701023:0:14418:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90700198c000 x1874741455576320/t0(0) o250->MGC192.168.202.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787893137.701055:0:14418:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import f31ac154-369d-4473-bca1-5cb1596e1d9c->MGS 00000020:01000004:0.0:1787893137.701094:0:14418:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1787893137.701099:0:14418:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1787893137.701113:0:14418:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff907105a8b370) 00000020:00000080:0.0:1787893137.701124:0:14418:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1787893137.704264:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700198c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f31ac154-369d-4473-bca1-5cb1596e1d9c:3304:1874741455576320:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787893137.704352:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893137.706059:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455576320 00000100:00100000:2.0:1787893137.706073:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455576320 00000100:00100000:2.0:1787893137.706128:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787893137.706137:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90711b76b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3304:x1874741455576320:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1787893137.706171:0:14430:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from f31ac154-369d-4473-bca1-5cb1596e1d9c@0@lo t0 exp 0000000000000000 cur 465 last 0 00000020:00000080:2.0:1787893137.706203:0:14430:0:(genops.c:1385:class_connect()) connect: client f31ac154-369d-4473-bca1-5cb1596e1d9c, cookie 0x825e3f5022b4b6ba 00000100:00080000:2.0:1787893137.706325:0:14430:0:(import.c:65:import_set_state_nolock()) ffff9071087e5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787893137.706404:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90711b76b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+5:3304:x1874741455576320:12345-0@lo:250:mount.lustre.0 Request processed in 267us (2052us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893137.706411:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787893137.706450:0:3304:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.129@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787893137.706459:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.129@tcp: connect to target with instance 0 00000100:00080000:2.0:1787893137.706465:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.129@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787893137.706470:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787893137.706473:0:3304:0:(import.c:65:import_set_state_nolock()) ffff907139e73000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787893137.706475:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787893137.706496:0:3304:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787893137.706501:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700198c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f31ac154-369d-4473-bca1-5cb1596e1d9c:3304:1874741455576320:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787893137.714436:0:14418:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787893137.718440:0:14418:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787893137.718450:0:14418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787893137.723872:0:14418:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787893137.723891:0:14418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1787893137.725898:0:14418:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1787893137.725914:0:14418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1787893137.729956:0:14418:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787893137.730202:0:14418:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1787893137.730208:0:14418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1787893137.732956:0:14418:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787893137.732978:0:14418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787893137.793862:0:14418:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787893137.795813:0:14418:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787893137.795823:0:14418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787893137.798804:0:14418:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787893137.798818:0:14418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787893137.799806:0:14418:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787893137.800591:0:14418:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787893137.800603:0:14418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787893137.802461:0:14418:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787893137.802537:0:14418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787893137.803409:0:14418:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787893137.803654:0:14418:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787893137.803660:0:14418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787893137.804449:0:14418:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787893137.804458:0:14418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787893137.805588:0:14418:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787893137.805928:0:14418:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787893137.805937:0:14418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787893137.806746:0:14418:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787893137.807073:0:14418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787893137.833421:0:14418:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787893137.834056:0:14418:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787893137.834064:0:14418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787893137.840513:0:14418:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787893137.840532:0:14418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787893137.841632:0:14418:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787893137.841644:0:14418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787893137.843234:0:14418:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787893137.843262:0:14418:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1787893137.843277:0:14418:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.129@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787893137.843512:0:14418:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.129@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787893137.843550:0:14418:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.129@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1787893137.843555:0:14418:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787893137.843557:0:14418:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787893137.843558:0:14418:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787893137.843559:0:14418:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787893137.843560:0:14418:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787893137.843562:0:14418:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787893137.843563:0:14418:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787893137.843565:0:14418:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787893137.843567:0:14418:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787893137.843568:0:14418:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787893137.843571:0:14418:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1787893137.843574:0:14418:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787893137.843576:0:14418:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787893137.843577:0:14418:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787893137.843578:0:14418:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787893137.843579:0:14418:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787893137.843580:0:14418:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787893137.843581:0:14418:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787893137.843582:0:14418:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787893137.843583:0:14418:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787893137.843584:0:14418:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787893137.843626:0:14418:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787893137.843649:0:14418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e628e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:14418:1874741455576448:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787893137.843732:0:14418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893137.843943:0:14418:0:(client.c:2715:ptlrpc_set_wait()) set ffff907105efae40 going to sleep for 11 seconds 00000100:00100000:3.0:1787893137.844008:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455576448 00000100:00100000:3.0:1787893137.844017:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455576448 00000100:00100000:3.0:1787893137.844095:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787893137.844110:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90711b769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+5:14418:x1874741455576448:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787893137.844156:0:14432:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787893137.844159:0:14432:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787893137.844162:0:14432:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1787893137.844537:0:14453:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1787893137.845049:0:14432:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1787893137.846616:0:14454:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1787893137.846625:0:14454:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1787893137.846627:0:14454:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1787893137.846661:0:14454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1787893137.847449:0:14432:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787893137.847462:0:14432:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787893137.853892:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90711b769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+5:14418:x1874741455576448:12345-0@lo:253:mount.lustre.0 Request processed in 9773us (10150us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893137.853906:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787893137.854072:0:14418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e628e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:14418:1874741455576448:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787893137.854091:0:14418:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787893137.854095:0:14418:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787893137.854097:0:14418:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787893137.854098:0:14418:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787893137.854099:0:14418:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787893137.854100:0:14418:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787893137.854101:0:14418:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787893137.854119:0:14418:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787893137.854121:0:14418:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787893137.854123:0:14418:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787893137.854124:0:14418:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787893137.854146:0:14418:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9071087e7000 from lustre-MDT0000 10000000:01000000:2.0:1787893137.854179:0:14418:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787893137.854182:0:14418:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787893137.854187:0:14418:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff907105a8cd28 10000000:01000000:2.0:1787893137.854192:0:14418:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787893137.854201:0:14418:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff907105a8cd28 from 1 10000000:01000000:2.0:1787893137.854205:0:14418:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787893137.854262:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff907139b9fe00/0x825e3f5022b4b6c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893137.854276:0:14418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff907139b9fe00/0x825e3f5022b4b6c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893137.854287:0:14418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff907139b9fe00/0x825e3f5022b4b6c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893137.854311:0:14418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e628e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:14418:1874741455576576:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787893137.854378:0:14418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893137.854428:0:14418:0:(client.c:2715:ptlrpc_set_wait()) set ffff907105efa3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787893137.855935:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455576576 00000100:00100000:3.0:1787893137.855955:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455576576 00000100:00100000:3.0:1787893137.856035:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787893137.856046:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90711b76b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+5:14418:x1874741455576576:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787893137.856066:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893137.856093:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9071013fd400/0x825e3f5022b4b6c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4b6c1 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893137.856126:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9071013fd400/0x825e3f5022b4b6c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4b6c1 expref: 6 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893137.856139:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9071013fd400/0x825e3f5022b4b6c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4b6c1 expref: 6 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893137.856148:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071013fd400, rc 0) 00000100:00100000:3.0:1787893137.856272:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90711b76b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+6:14418:x1874741455576576:12345-0@lo:101:mount.lustre.0 Request processed in 227us (1893us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893137.856279:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787893137.859216:0:14418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e628e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:14418:1874741455576576:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787893137.859247:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff907139b9fe00/0x825e3f5022b4b6c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b6c8 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893137.859259:0:14418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff907139b9fe00/0x825e3f5022b4b6c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4b6c8 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893137.859348:0:14418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:14418:1874741455576704:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787893137.859441:0:14418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893137.859619:0:14418:0:(client.c:2715:ptlrpc_set_wait()) set ffff907108653f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787893137.859664:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455576704 00000100:00100000:3.0:1787893137.859681:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455576704 00000100:00100000:3.0:1787893137.859790:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787893137.859801:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907119794050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+6:14418:x1874741455576704:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787893137.860176:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907119794050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+6:14418:x1874741455576704:12345-0@lo:501:mount.lustre.0 Request processed in 376us (735us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787893137.860185:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787893137.860248:0:14418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:14418:1874741455576704:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787893137.860275:0:14418:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787893137.860294:0:14418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff907139b9fe00/0x825e3f5022b4b6c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b6c8 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893137.860301:0:14418:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff907139b9fe00/0x825e3f5022b4b6c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b6c8 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893137.860308:0:14418:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9071087e7000 10000000:01000000:1.0:1787893137.860312:0:14418:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787893137.860315:0:14418:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9071087e7000 10000000:01000000:1.0:1787893137.860316:0:14418:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787893137.860318:0:14418:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9071087e7000 from 1 10000000:01000000:1.0:1787893137.860325:0:14418:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787893137.860348:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff90710153b600/0x825e3f5022b4b6cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893137.860355:0:14418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff90710153b600/0x825e3f5022b4b6cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893137.860365:0:14418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff90710153b600/0x825e3f5022b4b6cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893137.860380:0:14418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:14418:1874741455576832:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787893137.860407:0:14418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893137.860598:0:14418:0:(client.c:2715:ptlrpc_set_wait()) set ffff907108653f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787893137.860669:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455576832 00000100:00100000:3.0:1787893137.860675:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455576832 00000100:00100000:0.0:1787893137.860697:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787893137.860707:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907119795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+6:14418:x1874741455576832:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787893137.860717:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893137.860732:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907137fc8800/0x825e3f5022b4b6d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4b6cf expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893137.860765:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907137fc8800/0x825e3f5022b4b6d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4b6cf expref: 7 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893137.860776:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907137fc8800/0x825e3f5022b4b6d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4b6cf expref: 7 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893137.860785:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907137fc8800, rc 0) 00000100:00100000:0.0:1787893137.860820:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907119795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+7:14418:x1874741455576832:12345-0@lo:101:mount.lustre.0 Request processed in 116us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893137.860827:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787893137.860892:0:14418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:14418:1874741455576832:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787893137.860902:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff90710153b600/0x825e3f5022b4b6cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b6d6 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893137.860911:0:14418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff90710153b600/0x825e3f5022b4b6cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4b6d6 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893137.860923:0:14418:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787893137.860935:0:14418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff90710153b600/0x825e3f5022b4b6cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b6d6 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893137.860940:0:14418:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff90710153b600/0x825e3f5022b4b6cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b6d6 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893137.860944:0:14418:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787893137.860946:0:14418:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787893137.860955:0:14418:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9071087e7000 10000000:01000000:1.0:1787893137.860957:0:14418:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787893137.860959:0:14418:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787893137.860960:0:14418:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787893137.860975:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff90710153b200/0x825e3f5022b4b6dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893137.860981:0:14418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff90710153b200/0x825e3f5022b4b6dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893137.860987:0:14418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff90710153b200/0x825e3f5022b4b6dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893137.861000:0:14418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:14418:1874741455576960:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787893137.861024:0:14418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893137.861076:0:14418:0:(client.c:2715:ptlrpc_set_wait()) set ffff907108653f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787893137.861121:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455576960 00000100:00100000:3.0:1787893137.861124:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455576960 00000100:00100000:3.0:1787893137.861178:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787893137.861186:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907119795450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+7:14418:x1874741455576960:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787893137.861193:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893137.861199:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9071013fca00/0x825e3f5022b4b6e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4b6dd expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893137.861209:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9071013fca00/0x825e3f5022b4b6e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4b6dd expref: 8 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893137.861214:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9071013fca00/0x825e3f5022b4b6e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4b6dd expref: 8 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893137.861219:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071013fca00, rc 0) 00000100:00100000:3.0:1787893137.861283:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907119795450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+8:14418:x1874741455576960:12345-0@lo:101:mount.lustre.0 Request processed in 97us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893137.861289:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787893137.861350:0:14418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:14418:1874741455576960:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787893137.861360:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff90710153b200/0x825e3f5022b4b6dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b6e4 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893137.861367:0:14418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff90710153b200/0x825e3f5022b4b6dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4b6e4 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893137.861405:0:14418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:14418:1874741455577088:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787893137.861430:0:14418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893137.861521:0:14418:0:(client.c:2715:ptlrpc_set_wait()) set ffff907108653f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787893137.861577:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455577088 00000100:00100000:0.0:1787893137.861590:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455577088 00000100:00100000:0.0:1787893137.861652:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787893137.861660:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137bc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+8:14418:x1874741455577088:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787893137.862340:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137bc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+9:14418:x1874741455577088:12345-0@lo:501:mount.lustre.0 Request processed in 679us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893137.862349:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787893137.862474:0:14418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:14418:1874741455577088:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787893137.862522:0:14418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:14418:1874741455577216:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787893137.862569:0:14418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893137.862590:0:14418:0:(client.c:2715:ptlrpc_set_wait()) set ffff907108653f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787893137.862708:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455577216 00000100:00100000:0.0:1787893137.862713:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455577216 00000100:00100000:0.0:1787893137.862736:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787893137.862744:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137bc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+9:14418:x1874741455577216:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787893137.863348:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137bc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+9:14418:x1874741455577216:12345-0@lo:503:mount.lustre.0 Request processed in 602us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893137.863356:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787893137.863555:0:14418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:14418:1874741455577216:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787893137.865074:0:14455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010cc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f31ac154-369d-4473-bca1-5cb1596e1d9c:14455:1874741455577344:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787893137.865137:0:14455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893137.865215:0:14455:0:(client.c:2715:ptlrpc_set_wait()) set ffff907108653a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787893137.865253:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455577344 00000100:00100000:3.0:1787893137.865261:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455577344 00000100:00100000:3.0:1787893137.865338:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787893137.865354:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137bc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+9:14455:x1874741455577344:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787893137.865912:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137bc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+9:14455:x1874741455577344:12345-0@lo:502:llog_process_th.0 Request processed in 557us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893137.865922:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787893137.866049:0:14455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010cc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f31ac154-369d-4473-bca1-5cb1596e1d9c:14455:1874741455577344:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787893137.866080:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787893137.866091:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893137.866094:0:14455:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787893137.866100:0:14455:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787893137.866102:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787893137.866117:0:14455:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff907107efb370) 00000020:00000080:1.0:1787893137.866135:0:14455:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787893137.866141:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787893137.866218:0:14455:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787893137.866225:0:14455:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x825e3f5022b4b6f2 00000020:00000080:1.0:1787893137.866477:0:14455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787893137.866493:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787893137.866498:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893137.866499:0:14455:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787893137.866502:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787893137.866505:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893137.866506:0:14455:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787893137.866510:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787893137.866517:0:14455:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff907107ef8000) 00000020:00000080:1.0:1787893137.866527:0:14455:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787893137.866531:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787893137.866533:0:14455:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787893137.866542:0:14455:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787893137.866549:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787893137.866595:0:14455:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9071087e7000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787893137.866608:0:14455:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff907107efcd28) 00000020:00000080:1.0:1787893137.866617:0:14455:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787893137.866663:0:14455:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787893137.866669:0:14455:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x825e3f5022b4b707 00000020:00000080:1.0:1787893137.866803:0:14455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787893137.866823:0:14455:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787893137.866828:0:14455:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x825e3f5022b4b70e 00080000:01000000:1.0:1787893137.866833:0:14455:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787893137.866837:0:14455:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x825e3f5022b4b715 00010000:00010000:3.0:1787893137.958248:0:14455:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1787893137.958789:0:14455:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:3.0:1787893137.958986:0:14455:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787893137.959501:0:14455:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff90712ea799b8) 00000020:00000080:3.0:1787893137.959519:0:14455:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787893137.959576:0:14455:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787893137.959582:0:14455:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x825e3f5022b4b723 00000020:00000080:3.0:1787893137.968315:0:14455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787893137.991503:0:14455:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x825e3f5022b4b72a 00000020:00000080:2.0:1787893137.992058:0:14455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787893137.992072:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787893137.992079:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787893137.992081:0:14455:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787893137.992084:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787893137.992091:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787893137.992092:0:14455:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787893137.992097:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787893137.992412:0:14455:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787893137.992435:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787893137.992440:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787893137.992441:0:14455:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1787893137.992455:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787893137.992458:0:14455:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #10 00000020:01000000:2.0:1787893137.992460:0:14455:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787893137.992462:0:14455:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787893137.992463:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787893137.992466:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787893137.992468:0:14455:0:(obd_config.c:1563:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787893137.992470:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787893137.992473:0:14455:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787893137.992477:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787893137.992478:0:14455:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787893137.992491:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787893137.992497:0:14455:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.129@tcp to nid 0x20000c0a8ca81 (192.168.202.129@tcp) 00000020:01000000:2.0:1787893137.992526:0:14455:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787893137.992529:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787893137.992545:0:14455:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff90711badcd28) 00000020:00000080:2.0:1787893137.992560:0:14455:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1787893137.992566:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787893137.992637:0:14455:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787893137.992643:0:14455:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787893137.992649:0:14455:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x825e3f5022b4b738 00010000:00080000:2.0:1787893137.992683:0:14455:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9071075be800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.129@tcp at head 00010000:00010000:2.0:1787893137.992946:0:14455:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1787893137.994023:0:14455:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787893137.994237:0:14455:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787893137.995931:0:14455:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787893137.996014:0:14455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1787893137.996245:0:14455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1787893137.996901:0:14459:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787893137.996907:0:14459:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787893137.997718:0:14455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787893137.997739:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787893137.997957:0:14455:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787893137.997983:0:14455:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x825e3f5022b4b73f 00000100:00080000:2.0:1787893137.997994:0:14455:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787893137.998001:0:14455:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9071075be800 using connection 192.168.202.129@tcp/0@lo 00000100:00100000:2.0:1787893137.998044:0:14455:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90712e628e00 x1874741455577472/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787893137.998115:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874741455577472:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787893137.998193:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874741455577472 offset 0 length 520: 4 00000100:00080000:2.0:1787893137.998268:0:14455:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787893137.998340:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787893137.998345:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787893137.998347:0:14455:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787893137.998351:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787893137.998353:0:14455:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:2.0:1787893137.998355:0:14455:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787893137.998356:0:14455:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787893137.998358:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787893137.998360:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787893137.998361:0:14455:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787893137.998364:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787893137.998367:0:14455:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787893137.998370:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787893137.998372:0:14455:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787893137.998374:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787893137.998378:0:14455:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.129@tcp to nid 0x20000c0a8ca81 (192.168.202.129@tcp) 00000020:01000000:2.0:1787893137.998400:0:14455:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787893137.998403:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787893137.998416:0:14455:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff90711badb370) 00000020:00000080:2.0:1787893137.998430:0:14455:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1787893137.998435:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787893137.998526:0:14455:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787893137.998532:0:14455:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787893137.998544:0:14455:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x825e3f5022b4b74d 00010000:00080000:2.0:1787893137.998579:0:14455:0:(ldlm_lib.c:102:import_set_conn()) imp ffff907105a71800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.129@tcp at head 00010000:00010000:2.0:1787893137.998816:0:14455:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1787893137.999023:0:14455:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787893137.999048:0:14455:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787893137.999658:0:14455:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787893137.999738:0:14455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1787893137.999835:0:14455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1787893138.008679:0:14461:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787893138.008688:0:14461:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787893138.012677:0:14455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787893138.012695:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787893138.012734:0:14455:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787893138.012964:0:14455:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x825e3f5022b4b754 00000100:00080000:2.0:1787893138.012976:0:14455:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787893138.012982:0:14455:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff907105a71800 using connection 192.168.202.129@tcp/0@lo 00000100:00100000:2.0:1787893138.013027:0:14455:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90712e62a300 x1874741455577600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787893138.013097:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e62a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874741455577600:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787893138.013339:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874741455577600 offset 0 length 520: 4 00000100:00080000:2.0:1787893138.013401:0:14455:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787893138.013494:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787893138.013499:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787893138.013501:0:14455:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787893138.013504:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787893138.013508:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787893138.013509:0:14455:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787893138.013512:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787893138.013514:0:14455:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787893138.013516:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787893138.013518:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787893138.013519:0:14455:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787893138.013522:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787893138.013524:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787893138.013525:0:14455:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787893138.013529:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787893138.013573:0:14455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e629880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f31ac154-369d-4473-bca1-5cb1596e1d9c:14455:1874741455577728:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787893138.013626:0:14455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893138.013658:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455577728 00000100:00100000:2.0:1787893138.013664:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455577728 00000100:00100000:2.0:1787893138.013706:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787893138.013715:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137bc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+9:14455:x1874741455577728:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787893138.014337:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137bc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+9:14455:x1874741455577728:12345-0@lo:502:llog_process_th.0 Request processed in 617us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893138.014347:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787893138.014400:0:14455:0:(client.c:2715:ptlrpc_set_wait()) set ffff907107ed3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787893138.014425:0:14455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e629880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f31ac154-369d-4473-bca1-5cb1596e1d9c:14455:1874741455577728:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787893138.014601:0:14455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787893138.014607:0:14455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787893138.014608:0:14455:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787893138.014613:0:14455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1787893138.016050:0:14418:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1787893138.016077:0:14418:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787893138.016308:0:14418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff90710153b200/0x825e3f5022b4b6dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b6e4 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893138.016323:0:14418:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff90710153b200/0x825e3f5022b4b6dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b6e4 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787893138.016332:0:14418:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9071087e7000 from 1 10000000:01000000:0.0:1787893138.016352:0:14418:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787893138.016393:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff907137fc9c00/0x825e3f5022b4b75b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893138.016401:0:14418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff907137fc9c00/0x825e3f5022b4b75b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893138.016413:0:14418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff907137fc9c00/0x825e3f5022b4b75b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893138.016435:0:14418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700198f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:14418:1874741455577856:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787893138.016521:0:14418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893138.016565:0:14418:0:(client.c:2715:ptlrpc_set_wait()) set ffff90712c4cc6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787893138.016644:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455577856 00000100:00100000:1.0:1787893138.016653:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455577856 00000100:00100000:1.0:1787893138.016705:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787893138.016715:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137bc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+9:14418:x1874741455577856:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787893138.016729:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893138.016783:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90710153be00/0x825e3f5022b4b762 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4b75b expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893138.016829:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90710153be00/0x825e3f5022b4b762 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4b75b expref: 10 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893138.016842:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90710153be00/0x825e3f5022b4b762 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4b75b expref: 10 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893138.016852:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90710153be00, rc 0) 00000100:00100000:1.0:1787893138.016892:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137bc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+10:14418:x1874741455577856:12345-0@lo:101:mount.lustre.0 Request processed in 179us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893138.016908:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787893138.017041:0:14418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700198f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:14418:1874741455577856:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787893138.017055:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff907137fc9c00/0x825e3f5022b4b75b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b762 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893138.017063:0:14418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff907137fc9c00/0x825e3f5022b4b75b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4b762 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893138.017623:0:14418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700198f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:14418:1874741455577984:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1787893138.017669:0:14418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893138.017705:0:14418:0:(client.c:2715:ptlrpc_set_wait()) set ffff90712c4cc6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787893138.017978:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455577984 00000100:00100000:1.0:1787893138.017984:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455577984 00000100:00100000:1.0:1787893138.018019:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787893138.018027:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137bc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+10:14418:x1874741455577984:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1787893138.018042:0:14431:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787893138.018049:0:14431:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787893138.018114:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137bc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+10:14418:x1874741455577984:12345-0@lo:256:mount.lustre.0 Request processed in 88us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893138.018135:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787893138.018361:0:14418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700198f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:14418:1874741455577984:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1787893138.019112:0:14418:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787893138.019372:0:14418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff907137fc9c00/0x825e3f5022b4b75b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b762 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893138.019432:0:14418:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff907137fc9c00/0x825e3f5022b4b75b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b762 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893138.019497:0:14418:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9071087e7000 from 1 10000000:01000000:1.0:1787893138.019501:0:14418:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787893138.019532:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff90710153a000/0x825e3f5022b4b769 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893138.019540:0:14418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff90710153a000/0x825e3f5022b4b769 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893138.019552:0:14418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff90710153a000/0x825e3f5022b4b769 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893138.019570:0:14418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:14418:1874741455578112:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787893138.019617:0:14418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893138.019652:0:14418:0:(client.c:2715:ptlrpc_set_wait()) set ffff907002c15d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787893138.019701:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455578112 00000100:00100000:0.0:1787893138.019708:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455578112 00000100:00100000:0.0:1787893138.019778:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787893138.019787:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f9e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+10:14418:x1874741455578112:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787893138.019798:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893138.019812:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907137fc8600/0x825e3f5022b4b770 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4b769 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893138.019833:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907137fc8600/0x825e3f5022b4b770 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4b769 expref: 11 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893138.019843:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907137fc8600/0x825e3f5022b4b770 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4b769 expref: 11 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893138.019854:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907137fc8600, rc 0) 00000100:00100000:0.0:1787893138.019890:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f9e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+11:14418:x1874741455578112:12345-0@lo:101:mount.lustre.0 Request processed in 104us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893138.019896:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787893138.020044:0:14418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:14418:1874741455578112:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787893138.020058:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff90710153a000/0x825e3f5022b4b769 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b770 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893138.020078:0:14418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff90710153a000/0x825e3f5022b4b769 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4b770 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893138.020137:0:14418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:14418:1874741455578240:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787893138.020160:0:14418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893138.020175:0:14418:0:(client.c:2715:ptlrpc_set_wait()) set ffff907002c15d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787893138.020352:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455578240 00000100:00100000:2.0:1787893138.020358:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455578240 00000100:00100000:2.0:1787893138.020382:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787893138.020388:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f9e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+11:14418:x1874741455578240:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787893138.020837:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f9e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+11:14418:x1874741455578240:12345-0@lo:501:mount.lustre.0 Request processed in 447us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893138.020845:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787893138.021010:0:14418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:14418:1874741455578240:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787893138.021050:0:14418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:14418:1874741455578368:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787893138.021092:0:14418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893138.021132:0:14418:0:(client.c:2715:ptlrpc_set_wait()) set ffff907002c15d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787893138.021319:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455578368 00000100:00100000:2.0:1787893138.021324:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455578368 00000100:00100000:2.0:1787893138.021358:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787893138.021365:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f9e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+11:14418:x1874741455578368:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787893138.021531:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f9e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+11:14418:x1874741455578368:12345-0@lo:503:mount.lustre.0 Request processed in 166us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893138.021544:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787893138.021655:0:14418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:14418:1874741455578368:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787893138.025935:0:14463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700198f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f31ac154-369d-4473-bca1-5cb1596e1d9c:14463:1874741455578496:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787893138.026019:0:14463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893138.026057:0:14463:0:(client.c:2715:ptlrpc_set_wait()) set ffff90712c4cca80 going to sleep for 11 seconds 00000100:00100000:1.0:1787893138.026163:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455578496 00000100:00100000:1.0:1787893138.026171:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455578496 00000100:00100000:1.0:1787893138.026322:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787893138.026335:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f9e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+11:14463:x1874741455578496:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787893138.026644:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f9e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+11:14463:x1874741455578496:12345-0@lo:502:llog_process_th.0 Request processed in 311us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893138.027036:0:14463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700198f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f31ac154-369d-4473-bca1-5cb1596e1d9c:14463:1874741455578496:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787893138.027068:0:14463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787893138.027083:0:14463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893138.027086:0:14463:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787893138.027093:0:14463:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9071087e7000 00000020:00000080:0.0:1787893138.027095:0:14463:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787893138.027104:0:14463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787893138.027106:0:14463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893138.027107:0:14463:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787893138.027109:0:14463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787893138.027111:0:14463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893138.027112:0:14463:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787893138.027116:0:14463:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9071087e7000 00000020:00000080:0.0:1787893138.027117:0:14463:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787893138.027171:0:14463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787893138.029779:0:14463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893138.029789:0:14463:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787893138.029803:0:14463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787893138.029810:0:14463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893138.029812:0:14463:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787893138.029818:0:14463:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9071087e7000 00000020:00000080:0.0:1787893138.029821:0:14463:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787893138.029961:0:14463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700198f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f31ac154-369d-4473-bca1-5cb1596e1d9c:14463:1874741455578624:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787893138.030050:0:14463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893138.030089:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455578624 00000100:00100000:0.0:1787893138.030097:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455578624 00000100:00100000:0.0:1787893138.030141:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787893138.030151:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f9e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+12:14463:x1874741455578624:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787893138.033797:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f9e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+12:14463:x1874741455578624:12345-0@lo:502:llog_process_th.0 Request processed in 3637us (3738us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893138.033813:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787893138.033893:0:14463:0:(client.c:2715:ptlrpc_set_wait()) set ffff90712c4cc3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787893138.033925:0:14463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700198f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f31ac154-369d-4473-bca1-5cb1596e1d9c:14463:1874741455578624:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787893138.033970:0:14463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787893138.033978:0:14463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893138.033980:0:14463:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787893138.033985:0:14463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000100:00100000:1.0:1787893138.034654:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000020:01000000:1.0:1787893138.034694:0:14418:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1787893138.034716:0:14418:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787893138.034736:0:14418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff90710153a000/0x825e3f5022b4b769 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b770 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893138.034748:0:14418:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff90710153a000/0x825e3f5022b4b769 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b770 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893138.034836:0:14418:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787893138.034839:0:14418:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9071087e7000 10000000:01000000:1.0:1787893138.034842:0:14418:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9071087e7000 10000000:01000000:1.0:1787893138.034846:0:14418:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787893138.034851:0:14418:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9071087e7000 from 1 10000000:01000000:1.0:1787893138.034854:0:14418:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787893138.034887:0:14418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff90710153ba00/0x825e3f5022b4b777 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893138.034895:0:14418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff90710153ba00/0x825e3f5022b4b777 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893138.034905:0:14418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff90710153ba00/0x825e3f5022b4b777 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893138.034926:0:14418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:14418:1874741455578752:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787893138.034971:0:14418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893138.034993:0:14418:0:(client.c:2715:ptlrpc_set_wait()) set ffff907002c15240 going to sleep for 11 seconds 00000100:00100000:1.0:1787893138.035017:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455578752 00000100:00100000:1.0:1787893138.035024:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455578752 00000100:00100000:1.0:1787893138.035057:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787893138.035065:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f9e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+11:14418:x1874741455578752:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787893138.035077:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893138.035088:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90710153ae00/0x825e3f5022b4b77e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4b777 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893138.035112:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90710153ae00/0x825e3f5022b4b77e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4b777 expref: 12 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893138.035135:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90710153ae00/0x825e3f5022b4b77e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4b777 expref: 12 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893138.035144:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90710153ae00, rc 0) 00000100:00100000:1.0:1787893138.035177:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f9e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+12:14418:x1874741455578752:12345-0@lo:101:mount.lustre.0 Request processed in 113us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893138.035183:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787893138.035210:0:14418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:14418:1874741455578752:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787893138.035223:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff90710153ba00/0x825e3f5022b4b777 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b77e expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893138.035244:0:14418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff90710153ba00/0x825e3f5022b4b777 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4b77e expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893138.035284:0:14418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:14418:1874741455578880:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787893138.035308:0:14418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893138.035316:0:14418:0:(client.c:2715:ptlrpc_set_wait()) set ffff907002c15240 going to sleep for 11 seconds 00000100:00100000:1.0:1787893138.035334:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455578880 00000100:00100000:1.0:1787893138.035337:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455578880 00000100:00100000:1.0:1787893138.035354:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787893138.035360:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f9ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+12:14418:x1874741455578880:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787893138.035614:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f9ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+12:14418:x1874741455578880:12345-0@lo:501:mount.lustre.0 Request processed in 254us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893138.035620:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787893138.035645:0:14418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:14418:1874741455578880:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787893138.035680:0:14418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:14418:1874741455579008:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787893138.035718:0:14418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893138.035728:0:14418:0:(client.c:2715:ptlrpc_set_wait()) set ffff907002c15240 going to sleep for 11 seconds 00000100:00100000:1.0:1787893138.035748:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455579008 00000100:00100000:1.0:1787893138.035773:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455579008 00000100:00100000:1.0:1787893138.035791:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787893138.035797:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f9eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+12:14418:x1874741455579008:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787893138.035937:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f9eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+12:14418:x1874741455579008:12345-0@lo:503:mount.lustre.0 Request processed in 139us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893138.035944:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787893138.035977:0:14418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:14418:1874741455579008:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787893138.036499:0:14466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700198f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f31ac154-369d-4473-bca1-5cb1596e1d9c:14466:1874741455579136:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787893138.036543:0:14466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893138.037392:0:14466:0:(client.c:2715:ptlrpc_set_wait()) set ffff90712c4cc3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787893138.048829:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455579136 00000100:00100000:1.0:1787893138.048855:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455579136 00000100:00100000:1.0:1787893138.048938:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787893138.048949:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f9e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+12:14466:x1874741455579136:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787893138.049319:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f9e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+12:14466:x1874741455579136:12345-0@lo:502:llog_process_th.0 Request processed in 371us (12774us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893138.049329:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787893138.053557:0:14466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700198f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f31ac154-369d-4473-bca1-5cb1596e1d9c:14466:1874741455579136:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1787893138.053642:0:14466:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787893138.053659:0:14466:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff907105a88000) 00000020:00000080:0.0:1787893138.053680:0:14466:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1787893138.053813:0:14466:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9071087e7000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787893138.053817:0:14466:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9071087e7000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787893138.053820:0:14466:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9071087e7000 4 00010000:00080000:0.0:1787893138.053863:0:14466:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90712c543800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.129@tcp at head 00010000:00010000:0.0:1787893138.060351:0:14466:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1787893138.066575:0:14466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787893138.066619:0:14466:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787893138.066634:0:14466:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x825e3f5022b4b78c 00000100:00080000:0.0:1787893138.066647:0:14466:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787893138.066653:0:14466:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff90712c543800 using connection 192.168.202.129@tcp/0@lo 00000100:00100000:0.0:1787893138.066689:0:14466:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90700198f100 x1874741455579264/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787893138.066781:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700198f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874741455579264:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787893138.066862:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787893138.070336:0:14466:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787893138.070432:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455579264 00000100:00100000:0.0:1787893138.070444:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455579264 00000100:00100000:0.0:1787893138.070497:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787893138.070515:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070010cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1874741455579264:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787893138.074976:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070010cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1874741455579264:12345-0@lo:38:llog_process_th.0 Request processed in 4449us (8100us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787893138.074992:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787893138.079120:0:14466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700198c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f31ac154-369d-4473-bca1-5cb1596e1d9c:14466:1874741455579392:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787893138.079238:0:14466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893138.079282:0:14466:0:(client.c:2715:ptlrpc_set_wait()) set ffff90712c4cc000 going to sleep for 11 seconds 00000100:00100000:0.0:1787893138.079311:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455579392 00000100:00100000:0.0:1787893138.079322:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455579392 00000100:00100000:0.0:1787893138.079383:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787893138.079396:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f9eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+12:14466:x1874741455579392:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787893138.079697:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f9eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+12:14466:x1874741455579392:12345-0@lo:502:llog_process_th.0 Request processed in 302us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893138.079704:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787893138.079797:0:14466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700198c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f31ac154-369d-4473-bca1-5cb1596e1d9c:14466:1874741455579392:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787893138.079825:0:14466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000100:00100000:1.0:1787893138.083168:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787893138.083185:0:3304:0:(import.c:65:import_set_state_nolock()) ffff90712c543800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787893138.083194:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787893138.083200:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700198f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874741455579264:0@lo:38:llog_process_th.0 00000020:01000000:1.0:1787893138.083339:0:14418:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787893138.083371:0:14418:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787893138.083397:0:14418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff90710153ba00/0x825e3f5022b4b777 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b77e expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893138.083409:0:14418:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff90710153ba00/0x825e3f5022b4b777 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b77e expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787893138.083462:0:14418:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787893138.083464:0:14418:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787893138.083465:0:14418:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787893138.083466:0:14418:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787893138.083467:0:14418:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787893138.083469:0:14418:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787893138.083470:0:14418:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787893138.083472:0:14418:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787893138.083474:0:14418:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787893138.083475:0:14418:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787893138.083487:0:14418:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1787893138.083491:0:14418:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787893138.083492:0:14418:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787893138.083493:0:14418:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787893138.083494:0:14418:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787893138.083495:0:14418:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787893138.083496:0:14418:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787893138.083497:0:14418:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787893138.083498:0:14418:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787893138.083499:0:14418:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787893138.083500:0:14418:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787893138.083531:0:14418:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787893138.083552:0:14418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:14418:1874741455579520:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787893138.083628:0:14418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893138.083673:0:14418:0:(client.c:2715:ptlrpc_set_wait()) set ffff907002c15d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787893138.084387:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455579520 00000100:00100000:0.0:1787893138.084398:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455579520 00000100:00100000:0.0:1787893138.084458:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787893138.084468:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f9ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+12:14418:x1874741455579520:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787893138.084509:0:14432:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787893138.084522:0:14432:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787893138.148233:0:14432:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787893138.148252:0:14432:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1787893138.148277:0:14453:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787893138.148281:0:14453:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787893138.148378:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9071013fc600/0x825e3f5022b4b793 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893138.148400:0:14453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90710153be00/0x825e3f5022b4b762 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4b75b expref: 12 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893138.148409:0:14453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9071013fc600/0x825e3f5022b4b793 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893138.148520:0:14453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90710153be00/0x825e3f5022b4b762 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x825e3f5022b4b75b expref: 12 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893138.148555:0:14453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90710153be00/0x825e3f5022b4b762 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x825e3f5022b4b75b expref: 12 pid: 14432 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893138.148572:0:14453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c2a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14453:1874741455579648:0@lo:104: 00000100:00100000:3.0:1787893138.148642:0:14453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893138.148698:0:14453:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071086436c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787893138.148738:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455579648 00000100:00100000:3.0:1787893138.148746:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455579648 00000100:00100000:3.0:1787893138.148826:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787893138.148836:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f31ac154-369d-4473-bca1-5cb1596e1d9c+3:14453:x1874741455579648:12345-0@lo:104: 00010000:00010000:3.0:1787893138.148850:0:14420:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff907137fc9c00/0x825e3f5022b4b75b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4b762 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893138.148906:0:14420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787893138.148912:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f31ac154-369d-4473-bca1-5cb1596e1d9c+3:14453:x1874741455579648:12345-0@lo:104: Request processed in 79us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893138.148920:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1787893138.148946:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787893138.148953:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff907137fc9c00/0x825e3f5022b4b75b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4b762 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893138.148960:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc9c00 already unused, calling callback (ffffffffc1c05c20) 10000000:00010000:3.0:1787893138.148964:0:14426:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff907137fc9c00/0x825e3f5022b4b75b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x825e3f5022b4b762 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893138.148971:0:14426:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff907137fc9c00/0x825e3f5022b4b75b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x825e3f5022b4b762 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787893138.148989:0:14426:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff907137fc9c00/0x825e3f5022b4b75b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x825e3f5022b4b762 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787893138.148995:0:14426:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787893138.149023:0:14426:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff907137fc9c00/0x825e3f5022b4b75b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4b762 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893138.149029:0:14426:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787893138.149051:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff907137fc9c00/0x825e3f5022b4b75b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4b762 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893138.149059:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff907137fc9c00/0x825e3f5022b4b75b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4b762 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893138.149077:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893138.149079:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893138.149080:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893138.149107:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f31ac154-369d-4473-bca1-5cb1596e1d9c:3308:1874741455579776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787893138.149135:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893138.149227:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455579776 00000100:00100000:3.0:1787893138.149232:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455579776 00010000:00010000:3.0:1787893138.149250:0:14422:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90710153be00/0x825e3f5022b4b762 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4b75b expref: 13 pid: 14432 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893138.149271:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787893138.149278:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f31ac154-369d-4473-bca1-5cb1596e1d9c+13:3308:x1874741455579776:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787893138.152094:0:14453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c2a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14453:1874741455579648:0@lo:104: 00010000:00010000:2.0:1787893138.152125:0:14453:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9071013fc600/0x825e3f5022b4b793 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893138.153251:0:14422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893138.153266:0:14422:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90710153be00/0x825e3f5022b4b762 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4b75b expref: 13 pid: 14432 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893138.153299:0:14422:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90710153be00/0x825e3f5022b4b762 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x825e3f5022b4b75b expref: 13 pid: 14432 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893138.153326:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90710153be00/0x825e3f5022b4b762 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x825e3f5022b4b75b expref: 13 pid: 14432 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893138.153344:0:14422:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9071013fc600/0x825e3f5022b4b793 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893138.153353:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9071013fc600/0x825e3f5022b4b793 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787893138.153370:0:14422:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005088945s 00010000:00010000:3.0:1787893138.153374:0:14422:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9071013fc600/0x825e3f5022b4b793 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893138.153381:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9071013fc600/0x825e3f5022b4b793 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893138.153387:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9071013fc600/0x825e3f5022b4b793 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893138.153393:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9071013fc600/0x825e3f5022b4b793 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893138.153399:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071013fc600 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:3.0:1787893138.153403:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9071013fc600/0x825e3f5022b4b793 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893138.153410:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9071013fc600/0x825e3f5022b4b793 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893138.153432:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9071013fc600/0x825e3f5022b4b793 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893138.153451:0:14422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787893138.153472:0:14453:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9071013fc600/0x825e3f5022b4b793 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893138.153486:0:14453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9071013fc600/0x825e3f5022b4b793 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893138.153493:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9071013fc600/0x825e3f5022b4b793 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893138.153573:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f31ac154-369d-4473-bca1-5cb1596e1d9c+12:3308:x1874741455579776:12345-0@lo:103:ldlm_bl.0 Request processed in 4294us (4436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893138.153582:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787893138.153627:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f31ac154-369d-4473-bca1-5cb1596e1d9c:3308:1874741455579776:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787893138.172096:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f9ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+11:14418:x1874741455579520:12345-0@lo:253:mount.lustre.0 Request processed in 87620us (88458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893138.172194:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787893138.172414:0:14418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:14418:1874741455579520:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787893138.172430:0:14418:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787893138.172433:0:14418:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787893138.172434:0:14418:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787893138.172436:0:14418:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787893138.172437:0:14418:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787893138.172439:0:14418:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787893138.172440:0:14418:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787893138.172529:0:14418:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787893138.172532:0:14418:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787893138.172534:0:14418:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787893138.172535:0:14418:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787893138.172555:0:14418:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787893138.180397:0:14418:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1787893138.180662:0:14418:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787893138.181707:0:14418:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1787893138.181971:0:14418:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787893138.182567:0:14418:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1787893138.183032:0:14418:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1787893138.184643:0:14418:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1787893138.188656:0:14418:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1787893138.189741:0:14418:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1787893138.190693:0:14418:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1787893138.191441:0:14418:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1787893138.191629:0:14418:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1787893138.259351:0:14418:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1787893138.260143:0:14418:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1787893138.260265:0:14475:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1787893138.260270:0:14475:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1787893138.260832:0:14476:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1787893138.260938:0:14476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787893138.264048:0:14476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787893138.264147:0:14476:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787893138.264166:0:14476:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1787893138.274456:0:14418:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787893138.274894:0:14418:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787893138.275316:0:14418:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787893138.275325:0:14418:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787893138.275923:0:14418:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787893138.277663:0:14418:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787893138.279662:0:14418:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787893138.279736:0:14418:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1787893138.284738:0:14418:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1787893138.306615:0:14418:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1787893138.351282:0:14418:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787893138.351326:0:14418:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa30dc180b988 00100000:10000000:3.0:1787893138.351335:0:14418:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787893138.352689:0:14418:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787893138.352708:0:14418:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.129@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787893138.352728:0:14418:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787893138.352812:0:14418:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1787893138.711807:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787893138.766539:0:14434:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787893138.766549:0:14434:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9071087e7000 from 6 10000000:01000000:0.0:1787893138.766554:0:14434:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787893138.766628:0:14434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff907137fc9200/0x825e3f5022b4b79a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893138.766640:0:14434:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff907137fc9200/0x825e3f5022b4b79a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893138.766652:0:14434:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff907137fc9200/0x825e3f5022b4b79a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893138.766679:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700198c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f31ac154-369d-4473-bca1-5cb1596e1d9c:14434:1874741455579904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787893138.766779:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893138.766838:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff90713f545e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787893138.766864:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455579904 00000100:00100000:0.0:1787893138.766871:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455579904 00000100:00100000:0.0:1787893138.766923:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787893138.766933:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f9eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+11:14434:x1874741455579904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787893138.766947:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893138.766961:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907137fc9400/0x825e3f5022b4b7a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4b79a expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893138.766986:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907137fc9400/0x825e3f5022b4b7a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4b79a expref: 12 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893138.766995:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907137fc9400/0x825e3f5022b4b7a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4b79a expref: 12 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893138.767027:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907137fc9400, rc 0) 00000100:00100000:0.0:1787893138.767069:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f9eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+12:14434:x1874741455579904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893138.767076:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787893138.767126:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700198c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f31ac154-369d-4473-bca1-5cb1596e1d9c:14434:1874741455579904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787893138.767143:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff907137fc9200/0x825e3f5022b4b79a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b7a1 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893138.767152:0:14434:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff907137fc9200/0x825e3f5022b4b79a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4b7a1 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893138.767204:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700198c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f31ac154-369d-4473-bca1-5cb1596e1d9c:14434:1874741455580032:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787893138.767246:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893138.767258:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff90713f545e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787893138.767417:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455580032 00000100:00100000:1.0:1787893138.767422:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455580032 00000100:00100000:1.0:1787893138.767465:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787893138.767488:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f9ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+12:14434:x1874741455580032:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787893138.767506:0:14430:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787893138.767525:0:14430:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787893138.767528:0:14430:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1787893138.767627:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f9ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+12:14434:x1874741455580032:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 155us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893138.767635:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787893138.767671:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700198c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f31ac154-369d-4473-bca1-5cb1596e1d9c:14434:1874741455580032:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787893138.767710:0:14434:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787893138.767717:0:14434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff907137fc9200/0x825e3f5022b4b79a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b7a1 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893138.767726:0:14434:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff907137fc9200/0x825e3f5022b4b79a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b7a1 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787893139.088236:0:14469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787893139.721292:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787893140.105524:0:14469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787893140.750906:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893141.769090:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893142.798417:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787893142.935346:0:14718:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg229-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:0.0:1787893143.241026:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787893143.241035:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787893143.241038:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787893143.241040:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787893143.241043:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787893143.241046:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787893143.241051:0:37:0:(import.c:65:import_set_state_nolock()) ffff90712c543800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787893143.241066:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff90712c543800 using connection 192.168.202.129@tcp/0@lo 00000100:00100000:3.0:1787893143.241067:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700198d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f31ac154-369d-4473-bca1-5cb1596e1d9c:3305:1874741455580160:0@lo:400:kworker.0 00000100:00100000:0.0:1787893143.241094:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90700198df80 x1874741455580288/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787893143.241170:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893143.241183:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700198df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874741455580288:0@lo:38:kworker.0 00000100:00100000:0.0:1787893143.241226:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893143.241537:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455580160 00000100:00100000:1.0:1787893143.241546:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455580160 00000100:00100000:1.0:1787893143.241591:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787893143.241602:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f9ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+12:3305:x1874741455580160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893143.241662:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f9ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+12:3305:x1874741455580160:12345-0@lo:400:kworker.0 Request processed in 61us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893143.241669:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787893143.241724:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455580288 00000100:00100000:1.0:1787893143.241728:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455580288 00000100:00100000:1.0:1787893143.241744:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787893143.241766:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90700198ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1874741455580288:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787893143.241790:0:14439:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 471 last 0 00000020:00000080:1.0:1787893143.241827:0:14439:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x825e3f5022b4b7a8 00000004:00100000:1.0:1787893143.241841:0:14439:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787893143.241997:0:14439:0:(import.c:65:import_set_state_nolock()) ffff90710df9e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787893143.242034:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90700198ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874741455580288:12345-0@lo:38:kworker.0 Request processed in 284us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893143.242041:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787893143.242078:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700198d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f31ac154-369d-4473-bca1-5cb1596e1d9c:3305:1874741455580160:0@lo:400:kworker.0 00010000:00080000:0.0:1787893143.243257:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90700198df80 x1874741455580288/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787893153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787893143.243277:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787893143.243284:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787893143.243289:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787893143.243292:0:3304:0:(import.c:65:import_set_state_nolock()) ffff90712c543800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787893143.243298:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700198df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874741455580288:0@lo:38:kworker.0 00010000:00010000:3.0:1787893143.819628:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893144.841960:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893145.874597:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787893146.045832:0:14870:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc9a3bb810 20000000:00000080:0.0:1787893146.045860:0:14870:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90712fad4400 uarg=0000000000000000 20000000:01000000:0.0:1787893146.046393:0:14870:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787893146.046414:0:14870:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787893146.046421:0:14870:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787893146.051004:0:14871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1787893146.055675:0:14870:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787893146.072568:0:14870:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787893146.072649:0:14870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907137fc9600/0x825e3f5022b4b7af lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.072676:0:14870:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907137fc8600/0x825e3f5022b4b770 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4b769 expref: 11 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.072685:0:14870:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907137fc9600/0x825e3f5022b4b7af lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.072794:0:14870:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907137fc8600/0x825e3f5022b4b770 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x825e3f5022b4b769 expref: 11 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893146.072832:0:14870:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff907137fc8600/0x825e3f5022b4b770 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x825e3f5022b4b769 expref: 11 pid: 14431 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893146.072852:0:14870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700198df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14870:1874741455580416:0@lo:104: 00000100:00100000:0.0:1787893146.072949:0:14870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893146.073023:0:14870:0:(client.c:2715:ptlrpc_set_wait()) set ffff90713f545480 going to sleep for 11 seconds 00000100:00100000:2.0:1787893146.073052:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455580416 00000100:00100000:2.0:1787893146.073061:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455580416 00000100:00100000:2.0:1787893146.073129:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787893146.073140:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90700198ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f31ac154-369d-4473-bca1-5cb1596e1d9c+3:14870:x1874741455580416:12345-0@lo:104: 00010000:00010000:2.0:1787893146.073154:0:14421:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff90710153a000/0x825e3f5022b4b769 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4b770 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893146.073233:0:14421:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787893146.073241:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90700198ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f31ac154-369d-4473-bca1-5cb1596e1d9c+3:14870:x1874741455580416:12345-0@lo:104: Request processed in 102us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893146.073249:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1787893146.073276:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787893146.073284:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff90710153a000/0x825e3f5022b4b769 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4b770 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893146.073292:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153a000 already unused, calling callback (ffffffffc1c05c20) 10000000:00010000:2.0:1787893146.073296:0:14425:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff90710153a000/0x825e3f5022b4b769 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x825e3f5022b4b770 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893146.073304:0:14425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff90710153a000/0x825e3f5022b4b769 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x825e3f5022b4b770 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893146.073311:0:14870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700198df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14870:1874741455580416:0@lo:104: 10000000:00010000:2.0:1787893146.073312:0:14425:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff90710153a000/0x825e3f5022b4b769 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x825e3f5022b4b770 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787893146.073318:0:14425:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787893146.073338:0:14870:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907137fc9600/0x825e3f5022b4b7af lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893146.073366:0:14425:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff90710153a000/0x825e3f5022b4b769 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4b770 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893146.073381:0:14425:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787893146.073430:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff90710153a000/0x825e3f5022b4b769 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4b770 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893146.073438:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff90710153a000/0x825e3f5022b4b769 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4b770 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893146.073461:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893146.073463:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893146.073464:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893146.073656:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f31ac154-369d-4473-bca1-5cb1596e1d9c:3306:1874741455580544:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787893146.073688:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893146.073801:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455580544 00000100:00100000:3.0:1787893146.073806:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455580544 00010000:00010000:3.0:1787893146.073833:0:14423:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907137fc8600/0x825e3f5022b4b770 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4b769 expref: 12 pid: 14431 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893146.073866:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787893146.073873:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90700198df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f31ac154-369d-4473-bca1-5cb1596e1d9c+12:3306:x1874741455580544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787893146.073886:0:14423:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893146.073891:0:14423:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907137fc8600/0x825e3f5022b4b770 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4b769 expref: 12 pid: 14431 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893146.073903:0:14423:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907137fc8600/0x825e3f5022b4b770 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x825e3f5022b4b769 expref: 12 pid: 14431 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893146.073932:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907137fc8600/0x825e3f5022b4b770 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x825e3f5022b4b769 expref: 12 pid: 14431 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893146.073947:0:14423:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff907137fc9600/0x825e3f5022b4b7af lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893146.073956:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907137fc9600/0x825e3f5022b4b7af lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893146.073970:0:14423:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907137fc9600/0x825e3f5022b4b7af lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893146.073979:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907137fc9600/0x825e3f5022b4b7af lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893146.073986:0:14423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907137fc9600/0x825e3f5022b4b7af lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893146.073993:0:14423:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907137fc9600/0x825e3f5022b4b7af lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893146.073999:0:14423:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc9600 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:3.0:1787893146.074003:0:14423:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907137fc9600/0x825e3f5022b4b7af lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893146.074011:0:14423:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907137fc9600/0x825e3f5022b4b7af lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893146.074028:0:14423:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907137fc9600/0x825e3f5022b4b7af lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893146.074049:0:14423:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787893146.074050:0:14870:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907137fc9600/0x825e3f5022b4b7af lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893146.074058:0:14870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907137fc9600/0x825e3f5022b4b7af lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893146.074064:0:14870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907137fc9600/0x825e3f5022b4b7af lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893146.074084:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90700198df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f31ac154-369d-4473-bca1-5cb1596e1d9c+11:3306:x1874741455580544:12345-0@lo:103:ldlm_bl.0 Request processed in 212us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893146.074091:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787893146.074118:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f31ac154-369d-4473-bca1-5cb1596e1d9c:3306:1874741455580544:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787893146.890072:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893147.339996:0:3304:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787893137/real 1787893137] req@ffff90712e628e00 x1874741455577472/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787893147 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893147.340045:0:3304:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90712e628e00 x1874741455577472/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787893147 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787893147.340072:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9071075be800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787893147.340101:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787893147.340107:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874741455577472:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787893147.340406:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787893147.340413:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787893147.340416:0:38:0:(import.c:65:import_set_state_nolock()) ffff9071075be800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787893147.340423:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 465 00000100:00080000:2.0:1787893147.340430:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787893147.340439:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9071075be800 using connection 192.168.202.129@tcp/0@lo 00000100:00100000:2.0:1787893147.340466:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90712e62b480 x1874741455580800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787893147.340519:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787893147.340524:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787893147.340696:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e62b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874741455580800:0@lo:8:kworker.0 00000400:00000100:1.0:1787893147.340815:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874741455580800 offset 0 length 520: 4 00000100:00100000:3.0:1787893147.340963:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e628a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f31ac154-369d-4473-bca1-5cb1596e1d9c:3307:1874741455580672:0@lo:400:kworker.0 00000100:00100000:3.0:1787893147.341020:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893147.341049:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787893147.341055:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e629c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874741455580928:0@lo:400:kworker.0 00000100:00100000:3.0:1787893147.341090:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893147.341169:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455580672 00000100:00100000:1.0:1787893147.341179:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455580672 00000100:00100000:1.0:1787893147.341250:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787893147.341261:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f9eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+11:3307:x1874741455580672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893147.341329:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f9eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+11:3307:x1874741455580672:12345-0@lo:400:kworker.0 Request processed in 69us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893147.341337:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787893147.341418:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e628a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f31ac154-369d-4473-bca1-5cb1596e1d9c:3307:1874741455580672:0@lo:400:kworker.0 00000100:00100000:2.0:1787893147.344542:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455580928 00000100:00100000:2.0:1787893147.344565:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455580928 00000100:00100000:2.0:1787893147.344652:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787893147.344665:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874741455580928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893147.344852:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874741455580928:12345-0@lo:400:kworker.0 Request processed in 189us (3759us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893147.344861:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787893147.345046:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90712e629c00 x1874741455580928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893147.345065:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e629c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874741455580928:0@lo:400:kworker.0 10000000:01000000:0.0:1787893147.469564:0:14434:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787893147.469577:0:14434:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9071087e7000 from 10 10000000:01000000:0.0:1787893147.469585:0:14434:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787893147.469669:0:14434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff907137fc8a00/0x825e3f5022b4b7b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.469683:0:14434:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff907137fc8a00/0x825e3f5022b4b7b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.469712:0:14434:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff907137fc8a00/0x825e3f5022b4b7b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893147.469788:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700198ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f31ac154-369d-4473-bca1-5cb1596e1d9c:14434:1874741455581056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787893147.469900:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893147.469982:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff90713f545780 going to sleep for 11 seconds 00000100:00100000:1.0:1787893147.470180:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455581056 00000100:00100000:1.0:1787893147.470192:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455581056 00000100:00100000:1.0:1787893147.470270:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787893147.470282:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071075b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+11:14434:x1874741455581056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787893147.470308:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893147.470325:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90710153be00/0x825e3f5022b4b7bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4b7b6 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893147.470356:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90710153be00/0x825e3f5022b4b7bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4b7b6 expref: 12 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893147.470369:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90710153be00/0x825e3f5022b4b7bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4b7b6 expref: 12 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893147.470381:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90710153be00, rc 0) 00000100:00100000:1.0:1787893147.470458:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071075b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+12:14434:x1874741455581056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893147.470466:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787893147.470598:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700198ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f31ac154-369d-4473-bca1-5cb1596e1d9c:14434:1874741455581056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787893147.470617:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff907137fc8a00/0x825e3f5022b4b7b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b7bd expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893147.470627:0:14434:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff907137fc8a00/0x825e3f5022b4b7b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4b7bd expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893147.470711:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e62a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f31ac154-369d-4473-bca1-5cb1596e1d9c:14434:1874741455581184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787893147.470747:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893147.470808:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff907124dce540 going to sleep for 11 seconds 00000100:00100000:1.0:1787893147.470861:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455581184 00000100:00100000:1.0:1787893147.470866:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455581184 00000100:00100000:1.0:1787893147.470899:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787893147.470908:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071075b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+12:14434:x1874741455581184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787893147.475971:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071075b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+12:14434:x1874741455581184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 5039us (5198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893147.475985:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787893147.476035:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e62a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f31ac154-369d-4473-bca1-5cb1596e1d9c:14434:1874741455581184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787893147.476127:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700198e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f31ac154-369d-4473-bca1-5cb1596e1d9c:14434:1874741455581312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787893147.476350:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893147.476418:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff90713f545840 going to sleep for 11 seconds 00000100:00100000:1.0:1787893147.477225:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455581312 00000100:00100000:1.0:1787893147.477237:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455581312 00000100:00100000:1.0:1787893147.477293:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787893147.477302:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071075b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+12:14434:x1874741455581312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787893147.477597:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071075b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+12:14434:x1874741455581312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 295us (1248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893147.477618:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787893147.479014:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700198e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f31ac154-369d-4473-bca1-5cb1596e1d9c:14434:1874741455581312:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787893147.480600:0:14932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787893147.480949:0:14434:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787893147.480976:0:14434:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787893147.480992:0:14434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff907137fc8a00/0x825e3f5022b4b7b6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b7bd expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893147.481008:0:14434:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff907137fc8a00/0x825e3f5022b4b7b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b7bd expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893147.916121:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893148.360860:0:3304:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787893138/real 1787893138] req@ffff90712e62a300 x1874741455577600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787893148 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893148.360911:0:3304:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90712e62a300 x1874741455577600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787893148 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787893148.360938:0:3304:0:(import.c:65:import_set_state_nolock()) ffff907105a71800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787893148.360965:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787893148.360970:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e62a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874741455577600:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787893148.361071:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787893148.361077:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787893148.361079:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787893148.361082:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787893148.361101:0:38:0:(import.c:65:import_set_state_nolock()) ffff907105a71800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787893148.361107:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 465 00000100:00080000:2.0:1787893148.361113:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787893148.361121:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff907105a71800 using connection 192.168.202.129@tcp/0@lo 00000100:00100000:2.0:1787893148.361148:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90712e629500 x1874741455581568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787893148.361174:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e62aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f31ac154-369d-4473-bca1-5cb1596e1d9c:3305:1874741455581440:0@lo:400:kworker.0 00000100:00100000:2.0:1787893148.361189:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e629500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874741455581568:0@lo:8:kworker.0 00000100:00100000:3.0:1787893148.361295:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e628380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874741455581696:0@lo:400:kworker.0 00000400:00000100:2.0:1787893148.362594:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874741455581568 offset 0 length 520: 4 00000100:00100000:1.0:1787893148.367009:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893148.367340:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455581440 00000100:00100000:0.0:1787893148.367367:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455581440 00000100:00100000:0.0:1787893148.367445:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787893148.367461:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071075b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+12:3305:x1874741455581440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893148.367544:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071075b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+12:3305:x1874741455581440:12345-0@lo:400:kworker.0 Request processed in 87us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893148.367564:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787893148.367871:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e62aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f31ac154-369d-4473-bca1-5cb1596e1d9c:3305:1874741455581440:0@lo:400:kworker.0 00000100:00100000:3.0:1787893148.368573:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893148.368666:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455581696 00000100:00100000:0.0:1787893148.368673:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455581696 00000100:00100000:0.0:1787893148.368724:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787893148.368733:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874741455581696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893148.368826:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874741455581696:12345-0@lo:400:kworker.0 Request processed in 81us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893148.368835:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787893148.369549:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90712e628380 x1874741455581696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893148.369566:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e628380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874741455581696:0@lo:400:kworker.0 00010000:00010000:1.0:1787893148.937524:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893149.961148:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787893150.349270:0:14469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:2.0:1787893150.849566:0:15118:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787893150.849571:0:15118:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1787893150.849700:0:15118:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90712c5fa000 00000020:01000004:2.0:1787893150.849722:0:15118:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787893150.849739:0:15118:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787893150.849807:0:15118:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff90711bad99b8) 00000020:00000080:2.0:1787893150.849831:0:15118:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787893150.916671:0:15118:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787893150.917297:0:15118:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787893150.918964:0:15118:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787893150.920462:0:15118:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787893150.921006:0:15118:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787893150.923243:0:15118:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 555: rc = 0 00100000:10000000:2.0:1787893150.923407:0:15118:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 555: rc = 0 00100000:10000000:2.0:1787893150.923624:0:15118:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 555: rc = 0 00100000:10000000:2.0:1787893150.924237:0:15118:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 223: rc = 0 00100000:10000000:2.0:1787893150.924577:0:15118:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 223: rc = 0 00100000:10000000:2.0:1787893150.924932:0:15118:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 223: rc = 0 00100000:10000000:2.0:1787893150.925192:0:15118:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 223: rc = 0 00100000:10000000:2.0:1787893150.925458:0:15118:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 223: rc = 0 00100000:10000000:2.0:1787893150.925884:0:15118:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 223: rc = 0 00000020:00000080:2.0:1787893150.927359:0:15118:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787893150.927384:0:15118:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787893150.927395:0:15118:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x825e3f5022b4b7cb 00000020:01000004:2.0:1787893150.927404:0:15118:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787893150.927429:0:15118:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.129@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787893150.927433:0:15118:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787893150.927439:0:15118:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787893150.927443:0:15118:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787893150.927456:0:15118:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff90712ebccd28) 00000020:00000080:2.0:1787893150.927468:0:15118:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1787893150.928912:0:15118:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787893150.929129:0:15118:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787893150.929137:0:15118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787893150.930190:0:15118:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787893150.930201:0:15118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787893150.930590:0:15118:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787893150.930597:0:15118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1787893150.932036:0:15118:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787893150.932235:0:15118:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1787893150.932240:0:15118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787893150.939745:0:15118:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787893150.939784:0:15118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787893150.955961:0:15118:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787893150.956211:0:15118:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787893150.956220:0:15118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787893150.957714:0:15118:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787893150.957727:0:15118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787893150.958612:0:15118:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787893150.958623:0:15118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787893150.960672:0:15118:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787893150.961402:0:15118:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787893150.961409:0:15118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787893150.962074:0:15118:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787893150.962081:0:15118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:1.0:1787893150.990004:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893151.057660:0:15118:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787893151.057881:0:15118:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1787893151.057887:0:15118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1787893151.069267:0:15118:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1787893151.069286:0:15118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787893151.072509:0:15118:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787893151.072563:0:15118:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1787893151.072577:0:15118:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.129@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787893151.104502:0:15118:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.129@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787893151.104557:0:15118:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.129@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1787893151.104562:0:15118:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787893151.104564:0:15118:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787893151.104566:0:15118:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787893151.104567:0:15118:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787893151.104568:0:15118:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787893151.104569:0:15118:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787893151.104571:0:15118:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787893151.104573:0:15118:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787893151.104574:0:15118:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787893151.104578:0:15118:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1787893151.104580:0:15118:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787893151.104581:0:15118:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787893151.104582:0:15118:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787893151.104583:0:15118:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787893151.104584:0:15118:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787893151.104585:0:15118:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787893151.104586:0:15118:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787893151.104587:0:15118:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787893151.104588:0:15118:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787893151.104619:0:15118:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787893151.104643:0:15118:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010cf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15118:1874741455581824:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787893151.104736:0:15118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893151.108453:0:15118:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710a531240 going to sleep for 11 seconds 00000100:00100000:2.0:1787893151.110914:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455581824 00000100:00100000:2.0:1787893151.110931:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455581824 00000100:00100000:2.0:1787893151.111008:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787893151.111019:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071075b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+12:15118:x1874741455581824:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787893151.111057:0:14432:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787893151.111061:0:14432:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1787893151.111064:0:14432:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787893151.121880:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071075b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+12:15118:x1874741455581824:12345-0@lo:253:mount.lustre.0 Request processed in 10851us (17132us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893151.121899:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787893151.122541:0:15118:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010cf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15118:1874741455581824:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787893151.122577:0:15118:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787893151.122581:0:15118:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787893151.122582:0:15118:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787893151.122583:0:15118:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787893151.122585:0:15118:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787893151.122587:0:15118:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787893151.122588:0:15118:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787893151.122590:0:15118:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787893151.122592:0:15118:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787893151.122593:0:15118:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787893151.122615:0:15118:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90712c5fa000 from lustre-OST0000 10000000:01000000:2.0:1787893151.122642:0:15118:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787893151.122645:0:15118:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787893151.122652:0:15118:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff907105a8cd28 local copy 00010000:00010000:2.0:1787893151.122663:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff907139b9fe00/0x825e3f5022b4b6c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b6c8 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893151.122971:0:15118:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e629f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15118:1874741455581952:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787893151.123020:0:15118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893151.123121:0:15118:0:(client.c:2715:ptlrpc_set_wait()) set ffff90711b87f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787893151.123260:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455581952 00000100:00100000:1.0:1787893151.123267:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455581952 00000100:00100000:1.0:1787893151.123495:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787893151.123508:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071075b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+12:15118:x1874741455581952:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787893151.123695:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071075b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+12:15118:x1874741455581952:12345-0@lo:501:mount.lustre.0 Request processed in 189us (673us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787893151.123704:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787893151.123793:0:15118:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e629f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15118:1874741455581952:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787893151.123809:0:15118:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787893151.123954:0:15118:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787893151.123963:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff907139b9fe00/0x825e3f5022b4b6c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b6c8 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.123973:0:15118:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff907139b9fe00/0x825e3f5022b4b6c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b6c8 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787893151.123997:0:15118:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90712c5fa000 10000000:01000000:2.0:1787893151.124007:0:15118:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787893151.124013:0:15118:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff907105a8cd28 10000000:01000000:2.0:1787893151.124015:0:15118:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787893151.124018:0:15118:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff907105a8cd28 from 1 10000000:01000000:2.0:1787893151.124021:0:15118:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787893151.124049:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff907139b9f800/0x825e3f5022b4b7d9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.124057:0:15118:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff907139b9f800/0x825e3f5022b4b7d9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.124067:0:15118:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff907139b9f800/0x825e3f5022b4b7d9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893151.124082:0:15118:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e629f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15118:1874741455582080:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787893151.124113:0:15118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893151.124329:0:15118:0:(client.c:2715:ptlrpc_set_wait()) set ffff90711b87f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787893151.125117:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455582080 00000100:00100000:0.0:1787893151.125127:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455582080 00000100:00100000:0.0:1787893151.125172:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787893151.125193:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071075b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+12:15118:x1874741455582080:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787893151.125209:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893151.125230:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907137fc9800/0x825e3f5022b4b7e0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4b7d9 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.125256:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907137fc9800/0x825e3f5022b4b7e0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4b7d9 expref: 13 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.125266:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907137fc9800/0x825e3f5022b4b7e0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4b7d9 expref: 13 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.125289:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907137fc9800, rc 0) 00000100:00100000:0.0:1787893151.125354:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071075b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+13:15118:x1874741455582080:12345-0@lo:101:mount.lustre.0 Request processed in 174us (1240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893151.125369:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787893151.125630:0:15118:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e629f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15118:1874741455582080:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787893151.125646:0:15118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff907139b9f800/0x825e3f5022b4b7d9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b7e0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.125655:0:15118:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff907139b9f800/0x825e3f5022b4b7d9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4b7e0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787893151.125676:0:15118:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787893151.125692:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff907139b9f800/0x825e3f5022b4b7d9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b7e0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.125700:0:15118:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff907139b9f800/0x825e3f5022b4b7d9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b7e0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787893151.125719:0:15118:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787893151.125724:0:15118:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787893151.125731:0:15118:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787893151.125734:0:15118:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787893151.125783:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff907139b9e600/0x825e3f5022b4b7e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.125790:0:15118:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff907139b9e600/0x825e3f5022b4b7e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.125799:0:15118:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff907139b9e600/0x825e3f5022b4b7e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893151.125815:0:15118:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e629f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15118:1874741455582208:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787893151.125850:0:15118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893151.125875:0:15118:0:(client.c:2715:ptlrpc_set_wait()) set ffff90711b87f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787893151.125945:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455582208 00000100:00100000:0.0:1787893151.125950:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455582208 00000100:00100000:0.0:1787893151.125971:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787893151.125978:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071075b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+13:15118:x1874741455582208:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787893151.125985:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893151.125995:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907137fc9600/0x825e3f5022b4b7ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4b7e7 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.126011:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907137fc9600/0x825e3f5022b4b7ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4b7e7 expref: 14 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.126019:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907137fc9600/0x825e3f5022b4b7ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4b7e7 expref: 14 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.126026:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907137fc9600, rc 0) 00000100:00100000:0.0:1787893151.126061:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071075b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+14:15118:x1874741455582208:12345-0@lo:101:mount.lustre.0 Request processed in 83us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893151.126067:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787893151.126142:0:15118:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e629f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15118:1874741455582208:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787893151.126154:0:15118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff907139b9e600/0x825e3f5022b4b7e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b7ee expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.126161:0:15118:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff907139b9e600/0x825e3f5022b4b7e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4b7ee expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787893151.127110:0:15118:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1787893151.133156:0:15118:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787893151.133944:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1787893151.134002:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1787893151.134040:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1787893151.134103:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1787893151.134141:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1787893151.134176:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1787893151.134263:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1787893151.134272:0:15118:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1787893151.135239:0:15118:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e629f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15118:1874741455582336:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787893151.135448:0:15118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893151.135509:0:15118:0:(client.c:2715:ptlrpc_set_wait()) set ffff90711b87f540 going to sleep for 11 seconds 00000100:00100000:0.0:1787893151.135642:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455582336 00000100:00100000:0.0:1787893151.135651:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455582336 00000100:00100000:0.0:1787893151.135705:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787893151.135715:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071075b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+14:15118:x1874741455582336:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787893151.136169:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071075b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+14:15118:x1874741455582336:12345-0@lo:501:mount.lustre.0 Request processed in 454us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893151.136186:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787893151.137578:0:15118:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e629f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15118:1874741455582336:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787893151.137647:0:15118:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e629f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15118:1874741455582464:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787893151.137726:0:15118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893151.137840:0:15118:0:(client.c:2715:ptlrpc_set_wait()) set ffff90711b87f540 going to sleep for 11 seconds 00000100:00100000:3.0:1787893151.140607:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455582464 00000100:00100000:3.0:1787893151.140622:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455582464 00000100:00100000:3.0:1787893151.140794:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787893151.140805:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071075b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+14:15118:x1874741455582464:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787893151.141249:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071075b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+14:15118:x1874741455582464:12345-0@lo:503:mount.lustre.0 Request processed in 445us (3522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893151.141259:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787893151.142594:0:15118:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e629f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15118:1874741455582464:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787893151.143311:0:15118:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787893151.143410:0:15118:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e629f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15118:1874741455582592:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787893151.143488:0:15118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893151.150121:0:15118:0:(client.c:2715:ptlrpc_set_wait()) set ffff90711b87f540 going to sleep for 11 seconds 00000100:00100000:0.0:1787893151.157444:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455582592 00000100:00100000:0.0:1787893151.157472:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455582592 00000100:00100000:0.0:1787893151.160860:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787893151.160877:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107ff3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+14:15118:x1874741455582592:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787893151.162580:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107ff3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+14:15118:x1874741455582592:12345-0@lo:502:mount.lustre.0 Request processed in 1697us (19082us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893151.162595:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787893151.169700:0:15118:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e629f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15118:1874741455582592:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787893151.170120:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787893151.170189:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787893151.170222:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787893151.170269:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787893151.170305:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787893151.170339:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787893151.170419:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787893151.170922:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787893151.170970:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1787893151.171038:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1787893151.171076:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1787893151.171128:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1787893151.171180:0:15118:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e629f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15118:1874741455582720:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787893151.171278:0:15118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893151.173483:0:15118:0:(client.c:2715:ptlrpc_set_wait()) set ffff90711b87f540 going to sleep for 11 seconds 00000100:00100000:3.0:1787893151.185661:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455582720 00000100:00100000:3.0:1787893151.185678:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455582720 00000100:00100000:3.0:1787893151.185784:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787893151.185797:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107ff2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+14:15118:x1874741455582720:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787893151.186095:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107ff2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+14:15118:x1874741455582720:12345-0@lo:502:mount.lustre.0 Request processed in 300us (14817us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893151.186105:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787893151.187729:0:15118:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e629f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15118:1874741455582720:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787893151.187925:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1787893151.187942:0:15118:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1787893151.191439:0:15132:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787893151.191466:0:15132:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1787893151.191474:0:15132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787893151.191476:0:15132:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787893151.191483:0:15132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787893151.191501:0:15132:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff90712ea7b370) 00000020:00000080:3.0:1787893151.191525:0:15132:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787893151.191531:0:15132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787893151.191589:0:15132:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90712c5fa000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787893151.191597:0:15132:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787893151.191603:0:15132:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x825e3f5022b4b7fc 00010000:00010000:2.0:1787893151.203959:0:15132:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1787893151.204444:0:15132:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1787893151.206000:0:15132:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1787893151.215701:0:15132:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787893151.215717:0:15132:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787893151.215724:0:15132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893151.215727:0:15132:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787893151.215730:0:15132:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787893151.215733:0:15132:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1787893151.215734:0:15132:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787893151.215736:0:15132:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787893151.215738:0:15132:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787893151.215740:0:15132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893151.215741:0:15132:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787893151.215744:0:15132:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787893151.215746:0:15132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893151.215748:0:15132:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787893151.215774:0:15132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787893151.215776:0:15132:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787893151.215779:0:15132:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787893151.215781:0:15132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893151.215783:0:15132:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787893151.215794:0:15132:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787893151.215797:0:15132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893151.215798:0:15132:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787893151.215801:0:15132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787893151.215864:0:15132:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787893151.215869:0:15132:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893151.215870:0:15132:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787893151.215873:0:15132:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1787893151.216145:0:15118:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1787893151.216175:0:15118:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787893151.216198:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff907139b9e600/0x825e3f5022b4b7e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b7ee expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.216209:0:15118:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff907139b9e600/0x825e3f5022b4b7e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b7ee expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787893151.216217:0:15118:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90712c5fa000 from 1 10000000:01000000:2.0:1787893151.216220:0:15118:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787893151.216257:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff907139b9f400/0x825e3f5022b4b803 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.216265:0:15118:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff907139b9f400/0x825e3f5022b4b803 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.216275:0:15118:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff907139b9f400/0x825e3f5022b4b803 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893151.216313:0:15118:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e628700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15118:1874741455582848:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787893151.216414:0:15118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893151.216485:0:15118:0:(client.c:2715:ptlrpc_set_wait()) set ffff90711b87ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1787893151.216576:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455582848 00000100:00100000:1.0:1787893151.216583:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455582848 00000100:00100000:1.0:1787893151.216640:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787893151.216650:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107ff2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+14:15118:x1874741455582848:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787893151.216664:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893151.216678:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90710153b400/0x825e3f5022b4b80a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4b803 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893151.216723:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90710153b400/0x825e3f5022b4b80a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4b803 expref: 15 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893151.216736:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90710153b400/0x825e3f5022b4b80a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4b803 expref: 15 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893151.216746:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90710153b400, rc 0) 00000100:00100000:1.0:1787893151.216819:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107ff2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+15:15118:x1874741455582848:12345-0@lo:101:mount.lustre.0 Request processed in 171us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893151.216826:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787893151.217018:0:15118:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e628700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15118:1874741455582848:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787893151.217034:0:15118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff907139b9f400/0x825e3f5022b4b803 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b80a expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.217044:0:15118:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff907139b9f400/0x825e3f5022b4b803 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4b80a expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787893151.217613:0:15118:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787893151.217963:0:15118:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787893151.218219:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787893151.218261:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787893151.218317:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787893151.218325:0:15118:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787893151.218414:0:15118:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e628700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15118:1874741455582976:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787893151.218474:0:15118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893151.218510:0:15118:0:(client.c:2715:ptlrpc_set_wait()) set ffff90711b87ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1787893151.221166:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455582976 00000100:00100000:1.0:1787893151.221179:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455582976 00000100:00100000:1.0:1787893151.221233:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787893151.221243:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107ff1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+15:15118:x1874741455582976:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787893151.221553:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107ff1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+15:15118:x1874741455582976:12345-0@lo:501:mount.lustre.0 Request processed in 310us (3079us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893151.221560:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787893151.224580:0:15118:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e628700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15118:1874741455582976:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787893151.224664:0:15118:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e628700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15118:1874741455583104:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787893151.224808:0:15118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893151.226449:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455583104 00000100:00100000:2.0:1787893151.226463:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455583104 00000100:00100000:2.0:1787893151.226519:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787893151.226529:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107ff1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+15:15118:x1874741455583104:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787893151.226773:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107ff1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+15:15118:x1874741455583104:12345-0@lo:503:mount.lustre.0 Request processed in 243us (2020us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893151.226781:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787893151.228170:0:15118:0:(client.c:2715:ptlrpc_set_wait()) set ffff90711b87ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787893151.228208:0:15118:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e628700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15118:1874741455583104:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787893151.229673:0:15118:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787893151.229923:0:15118:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e628700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15118:1874741455583232:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787893151.230011:0:15118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893151.230178:0:15118:0:(client.c:2715:ptlrpc_set_wait()) set ffff90711b87ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1787893151.236681:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455583232 00000100:00100000:1.0:1787893151.236698:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455583232 00000100:00100000:1.0:1787893151.236788:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787893151.236800:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107ff2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+15:15118:x1874741455583232:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787893151.237546:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107ff2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+15:15118:x1874741455583232:12345-0@lo:502:mount.lustre.0 Request processed in 745us (7532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893151.237557:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787893151.242584:0:15118:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e628700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15118:1874741455583232:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787893151.243008:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1787893151.243072:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1787893151.243114:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1787893151.243144:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1787893151.243171:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1787893151.243213:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1787893151.243246:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1787893151.243292:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1787893151.243351:0:15118:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e628700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15118:1874741455583360:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787893151.244554:0:15118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893151.244606:0:15118:0:(client.c:2715:ptlrpc_set_wait()) set ffff90711b87ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787893151.245746:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455583360 00000100:00100000:0.0:1787893151.245773:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455583360 00000100:00100000:0.0:1787893151.245837:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787893151.245847:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107ff0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+15:15118:x1874741455583360:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787893151.246126:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107ff0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+15:15118:x1874741455583360:12345-0@lo:502:mount.lustre.0 Request processed in 280us (1576us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893151.246135:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787893151.246297:0:15118:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e628700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15118:1874741455583360:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787893151.246600:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1787893151.246615:0:15118:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1787893151.250157:0:15136:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787893151.250173:0:15136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787893151.250175:0:15136:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787893151.250185:0:15136:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90712c5fa000 00000020:00000080:2.0:1787893151.250187:0:15136:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787893151.250194:0:15136:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787893151.250197:0:15136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787893151.250212:0:15136:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787893151.250216:0:15136:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787893151.250219:0:15136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787893151.250220:0:15136:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787893151.250223:0:15136:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90712c5fa000 00000020:00000080:2.0:1787893151.250226:0:15136:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787893151.253190:0:15136:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787893151.253209:0:15136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787893151.253211:0:15136:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787893151.253217:0:15136:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787893151.253220:0:15136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787893151.253222:0:15136:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787893151.253227:0:15136:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90712c5fa000 00000020:00000080:2.0:1787893151.253229:0:15136:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787893151.253347:0:15136:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787893151.253351:0:15136:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787893151.253352:0:15136:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787893151.253356:0:15136:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1787893151.253583:0:15118:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1787893151.253611:0:15118:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787893151.253639:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff907139b9f400/0x825e3f5022b4b803 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b80a expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.253652:0:15118:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff907139b9f400/0x825e3f5022b4b803 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b80a expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787893151.253712:0:15118:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787893151.253715:0:15118:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90712c5fa000 10000000:01000000:3.0:1787893151.253718:0:15118:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90712c5fa000 10000000:01000000:3.0:1787893151.253722:0:15118:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787893151.253729:0:15118:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90712c5fa000 from 1 10000000:01000000:3.0:1787893151.253732:0:15118:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787893151.253794:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9071013fc600/0x825e3f5022b4b811 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.253802:0:15118:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9071013fc600/0x825e3f5022b4b811 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.253814:0:15118:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9071013fc600/0x825e3f5022b4b811 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893151.253839:0:15118:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15118:1874741455583488:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787893151.253909:0:15118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893151.253943:0:15118:0:(client.c:2715:ptlrpc_set_wait()) set ffff907108112180 going to sleep for 11 seconds 00000100:00100000:1.0:1787893151.255725:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455583488 00000100:00100000:1.0:1787893151.255739:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455583488 00000100:00100000:1.0:1787893151.255811:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787893151.255822:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107ff3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+15:15118:x1874741455583488:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787893151.255839:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893151.255855:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90710153a200/0x825e3f5022b4b818 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4b811 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893151.255879:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90710153a200/0x825e3f5022b4b818 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4b811 expref: 16 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893151.255889:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90710153a200/0x825e3f5022b4b818 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4b811 expref: 16 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893151.255897:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90710153a200, rc 0) 00000100:00100000:1.0:1787893151.255959:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107ff3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+16:15118:x1874741455583488:12345-0@lo:101:mount.lustre.0 Request processed in 139us (2049us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893151.255965:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787893151.257622:0:15118:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15118:1874741455583488:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787893151.257649:0:15118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9071013fc600/0x825e3f5022b4b811 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b818 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.257660:0:15118:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9071013fc600/0x825e3f5022b4b811 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4b818 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787893151.258246:0:15118:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1787893151.258798:0:15118:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787893151.259044:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787893151.259096:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1787893151.259130:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1787893151.259191:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1787893151.259229:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1787893151.259298:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1787893151.259339:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1787893151.259392:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1787893151.259457:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1787893151.259497:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1787893151.259531:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1787893151.259581:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1787893151.259618:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1787893151.259654:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1787893151.259704:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1787893151.259742:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1787893151.259807:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1787893151.259856:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1787893151.259894:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1787893151.259945:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1787893151.259993:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1787893151.260029:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1787893151.260058:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1787893151.260103:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1787893151.260139:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1787893151.260175:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1787893151.260223:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1787893151.260259:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1787893151.260329:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1787893151.260336:0:15118:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1787893151.267189:0:15118:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15118:1874741455583616:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787893151.267265:0:15118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893151.267324:0:15118:0:(client.c:2715:ptlrpc_set_wait()) set ffff907108112180 going to sleep for 11 seconds 00000100:00100000:2.0:1787893151.271599:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455583616 00000100:00100000:2.0:1787893151.271615:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455583616 00000100:00100000:2.0:1787893151.271681:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787893151.271694:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107ff2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+16:15118:x1874741455583616:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787893151.275869:0:15118:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15118:1874741455583616:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787893151.275929:0:15118:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15118:1874741455583744:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787893151.275936:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107ff2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+16:15118:x1874741455583616:12345-0@lo:501:mount.lustre.0 Request processed in 4245us (8670us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893151.275948:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787893151.275976:0:15118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893151.275994:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455583744 00000100:00100000:2.0:1787893151.276000:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455583744 00000100:00100000:3.0:1787893151.276006:0:15118:0:(client.c:2715:ptlrpc_set_wait()) set ffff907108112180 going to sleep for 11 seconds 00000100:00100000:2.0:1787893151.276045:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787893151.276054:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107ff0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+16:15118:x1874741455583744:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787893151.276274:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107ff0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+16:15118:x1874741455583744:12345-0@lo:503:mount.lustre.0 Request processed in 221us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893151.276288:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787893151.276849:0:15118:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15118:1874741455583744:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787893151.279840:0:15118:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787893151.279939:0:15118:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15118:1874741455583872:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787893151.280028:0:15118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893151.280072:0:15118:0:(client.c:2715:ptlrpc_set_wait()) set ffff907108112180 going to sleep for 11 seconds 00000100:00100000:1.0:1787893151.280167:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455583872 00000100:00100000:1.0:1787893151.280177:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455583872 00000100:00100000:1.0:1787893151.280243:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787893151.280253:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107ff0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+16:15118:x1874741455583872:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787893151.280583:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107ff0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+16:15118:x1874741455583872:12345-0@lo:502:mount.lustre.0 Request processed in 330us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893151.280602:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787893151.281170:0:15118:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15118:1874741455583872:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787893151.282313:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1787893151.282973:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1787893151.283009:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1787893151.285162:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1787893151.285219:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1787893151.285270:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1787893151.288135:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1787893151.288270:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1787893151.288392:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1787893151.288431:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1787893151.288464:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1787893151.288514:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1787893151.288548:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1787893151.288579:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1787893151.288626:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1787893151.288661:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1787893151.288697:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1787893151.288745:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1787893151.288812:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1787893151.288870:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1787893151.288935:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1787893151.288977:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1787893151.289014:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1787893151.291932:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1787893151.291990:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1787893151.292022:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1787893151.292068:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1787893151.292104:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1787893151.292134:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1787893151.292178:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1787893151.292214:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1787893151.292248:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1787893151.293514:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1787893151.293616:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1787893151.293653:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1787893151.293724:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1787893151.295513:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1787893151.295592:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1787893151.295668:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1787893151.295706:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1787893151.296109:0:15118:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15118:1874741455584000:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787893151.296213:0:15118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893151.296267:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455584000 00000100:00100000:3.0:1787893151.296289:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455584000 00000100:00100000:3.0:1787893151.296469:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787893151.296479:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107ff0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+16:15118:x1874741455584000:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787893151.296710:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107ff0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+16:15118:x1874741455584000:12345-0@lo:502:mount.lustre.0 Request processed in 232us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893151.296719:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787893151.296802:0:15118:0:(client.c:2715:ptlrpc_set_wait()) set ffff907108112180 going to sleep for 11 seconds 00000100:00100000:3.0:1787893151.296828:0:15118:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15118:1874741455584000:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787893151.296933:0:15118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1787893151.296944:0:15118:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1787893151.303216:0:15141:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787893151.303239:0:15141:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff90712ea78000) 00000020:00000080:3.0:1787893151.303264:0:15141:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1787893151.303523:0:15141:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90712c5fa000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787893151.303529:0:15141:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90712c5fa000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787893151.303531:0:15141:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90712c5fa000 3 00010000:00080000:3.0:1787893151.303578:0:15141:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9071184b6800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.129@tcp at head 00010000:00010000:3.0:1787893151.313000:0:15141:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1787893151.313896:0:15141:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1787893151.313941:0:15141:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787893151.313955:0:15141:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x825e3f5022b4b826 00000100:00080000:3.0:1787893151.313966:0:15141:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787893151.313973:0:15141:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9071184b6800 using connection 192.168.202.129@tcp/0@lo 00000100:00100000:3.0:1787893151.314010:0:15141:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9070038c0700 x1874741455584128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787893151.314034:0:15141:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787893151.314055:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1874741455584128:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1787893151.314057:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787893151.314061:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787893151.314063:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787893151.314066:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787893151.314104:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874741455584256:0@lo:400:kworker.0 00000100:00100000:0.0:1787893151.314127:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893151.314210:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455584128 00000100:00100000:0.0:1787893151.314217:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455584128 00000100:00100000:0.0:1787893151.314252:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787893151.314260:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90700198e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1874741455584128:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787893151.314285:0:14439:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 479 last 0 00000020:00000080:0.0:1787893151.314332:0:14439:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x825e3f5022b4b82d 00000004:00100000:0.0:1787893151.314349:0:14439:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787893151.314391:0:14439:0:(import.c:65:import_set_state_nolock()) ffff90710510b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787893151.314446:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90700198e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874741455584128:12345-0@lo:38:llog_process_th.0 Request processed in 185us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893151.314466:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787893151.314500:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787893151.314549:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9070038c0700 x1874741455584128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787893161 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893151.314560:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787893151.314567:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1787893151.314574:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787893151.314577:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787893151.314579:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9071184b6800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787893151.314584:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1874741455584128:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787893151.315480:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455584256 00000100:00100000:3.0:1787893151.315492:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455584256 00000100:00100000:3.0:1787893151.315534:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787893151.315541:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90700198dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874741455584256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893151.315599:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90700198dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874741455584256:12345-0@lo:400:kworker.0 Request processed in 57us (1098us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893151.315606:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787893151.322648:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9070038c3100 x1874741455584256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893151.322670:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874741455584256:0@lo:400:kworker.0 00000040:00080000:2.0:1787893151.331228:0:15141:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1787893151.331942:0:15118:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787893151.331972:0:15118:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787893151.331996:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9071013fc600/0x825e3f5022b4b811 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b818 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893151.332008:0:15118:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9071013fc600/0x825e3f5022b4b811 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b818 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787893151.332055:0:15118:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787893151.332057:0:15118:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787893151.332059:0:15118:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787893151.332060:0:15118:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787893151.332061:0:15118:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787893151.332062:0:15118:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787893151.332063:0:15118:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787893151.332066:0:15118:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787893151.332067:0:15118:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787893151.332075:0:15118:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1787893151.332078:0:15118:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787893151.332079:0:15118:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787893151.332080:0:15118:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787893151.332081:0:15118:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787893151.332082:0:15118:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787893151.332083:0:15118:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787893151.332084:0:15118:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787893151.332085:0:15118:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787893151.332086:0:15118:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787893151.332114:0:15118:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787893151.332134:0:15118:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700198f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15118:1874741455584384:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787893151.332203:0:15118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893151.332241:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455584384 00000100:00100000:0.0:1787893151.332248:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455584384 00000100:00100000:0.0:1787893151.332288:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787893151.332296:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107ff3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+16:15118:x1874741455584384:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787893151.332382:0:14432:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787893151.332395:0:14432:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1787893151.344778:0:15118:0:(client.c:2715:ptlrpc_set_wait()) set ffff90713f588180 going to sleep for 11 seconds 20000000:01000000:0.0:1787893151.375948:0:14432:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787893151.375965:0:14432:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787893151.375984:0:14453:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787893151.375989:0:14453:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787893151.376016:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9071013fce00/0x825e3f5022b4b834 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.376038:0:14453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907137fc9400/0x825e3f5022b4b7a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4b79a expref: 16 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.376046:0:14453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9071013fce00/0x825e3f5022b4b834 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.376090:0:14453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907137fc9400/0x825e3f5022b4b7a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x825e3f5022b4b79a expref: 16 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.376107:0:14453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff907137fc9400/0x825e3f5022b4b7a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x825e3f5022b4b79a expref: 16 pid: 14431 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893151.376123:0:14453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c0000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14453:1874741455584512:0@lo:104: 00000100:00100000:3.0:1787893151.376190:0:14453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893151.376411:0:14453:0:(client.c:2715:ptlrpc_set_wait()) set ffff907108112840 going to sleep for 11 seconds 00000100:00100000:2.0:1787893151.381702:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455584512 00000100:00100000:2.0:1787893151.381719:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455584512 00000100:00100000:2.0:1787893151.381795:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787893151.381805:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f31ac154-369d-4473-bca1-5cb1596e1d9c+3:14453:x1874741455584512:12345-0@lo:104: 00010000:00010000:2.0:1787893151.381823:0:14421:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff907137fc9200/0x825e3f5022b4b79a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4b7a1 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.381923:0:14421:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787893151.381929:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f31ac154-369d-4473-bca1-5cb1596e1d9c+3:14453:x1874741455584512:12345-0@lo:104: Request processed in 127us (5740us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893151.381935:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1787893151.381958:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787893151.381964:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff907137fc9200/0x825e3f5022b4b79a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4b7a1 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.381972:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc9200 already unused, calling callback (ffffffffc1c05c20) 10000000:00010000:2.0:1787893151.381976:0:14425:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff907137fc9200/0x825e3f5022b4b79a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x825e3f5022b4b7a1 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.381985:0:14425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff907137fc9200/0x825e3f5022b4b79a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x825e3f5022b4b7a1 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787893151.381992:0:14425:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff907137fc9200/0x825e3f5022b4b79a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x825e3f5022b4b7a1 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787893151.381998:0:14425:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787893151.382036:0:14425:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff907137fc9200/0x825e3f5022b4b79a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4b7a1 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.382056:0:14425:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787893151.382078:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff907137fc9200/0x825e3f5022b4b79a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4b7a1 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.382085:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff907137fc9200/0x825e3f5022b4b79a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4b7a1 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.382102:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893151.382104:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893151.382105:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893151.382128:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e628700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f31ac154-369d-4473-bca1-5cb1596e1d9c:3308:1874741455584640:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787893151.382167:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893151.382230:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455584640 00000100:00100000:2.0:1787893151.382234:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455584640 00010000:00010000:2.0:1787893151.382251:0:14424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907137fc9400/0x825e3f5022b4b7a1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4b79a expref: 17 pid: 14431 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893151.382288:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787893151.382297:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e628000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f31ac154-369d-4473-bca1-5cb1596e1d9c+17:3308:x1874741455584640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787893151.382308:0:14424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893151.382314:0:14424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907137fc9400/0x825e3f5022b4b7a1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4b79a expref: 17 pid: 14431 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.382334:0:14424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907137fc9400/0x825e3f5022b4b7a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x825e3f5022b4b79a expref: 17 pid: 14431 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.382353:0:14424:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9071013fce00/0x825e3f5022b4b834 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.382380:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9071013fce00/0x825e3f5022b4b834 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787893151.382395:0:14424:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006406586s 00010000:00010000:2.0:1787893151.382399:0:14424:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9071013fce00/0x825e3f5022b4b834 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.382406:0:14424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9071013fce00/0x825e3f5022b4b834 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.382412:0:14424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9071013fce00/0x825e3f5022b4b834 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.382417:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9071013fce00/0x825e3f5022b4b834 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.382422:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071013fce00 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:2.0:1787893151.382426:0:14424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9071013fce00/0x825e3f5022b4b834 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.382433:0:14424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9071013fce00/0x825e3f5022b4b834 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.382442:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9071013fce00/0x825e3f5022b4b834 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893151.382451:0:14424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893151.382483:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e628000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f31ac154-369d-4473-bca1-5cb1596e1d9c+17:3308:x1874741455584640:12345-0@lo:103:ldlm_bl.0 Request processed in 187us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893151.382490:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787893151.382537:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e628700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f31ac154-369d-4473-bca1-5cb1596e1d9c:3308:1874741455584640:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787893151.382819:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907137fc9400/0x825e3f5022b4b7a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x825e3f5022b4b79a expref: 16 pid: 14431 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893151.382830:0:14453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c0000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14453:1874741455584512:0@lo:104: 00010000:00010000:3.0:1787893151.382853:0:14453:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9071013fce00/0x825e3f5022b4b834 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.382861:0:14453:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9071013fce00/0x825e3f5022b4b834 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.382867:0:14453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9071013fce00/0x825e3f5022b4b834 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893151.382873:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9071013fce00/0x825e3f5022b4b834 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893151.384167:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107ff3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+15:15118:x1874741455584384:12345-0@lo:253:mount.lustre.0 Request processed in 51865us (51956us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893151.384179:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787893151.384254:0:15118:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700198f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15118:1874741455584384:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787893151.384267:0:15118:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787893151.384271:0:15118:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787893151.384272:0:15118:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787893151.384274:0:15118:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787893151.384275:0:15118:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787893151.384276:0:15118:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787893151.384407:0:15118:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787893151.384409:0:15118:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787893151.384411:0:15118:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787893151.384412:0:15118:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787893151.384428:0:15118:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787893151.391643:0:15118:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787893151.391860:0:15118:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787893151.392021:0:15118:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787893151.392174:0:15118:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787893151.392317:0:15118:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787893151.393188:0:15118:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787893151.394530:0:15118:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1787893151.465039:0:15118:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1787893151.465063:0:15118:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1787893151.465097:0:15118:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787893151.465160:0:15118:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.129@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787893151.465175:0:15118:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787893151.465210:0:15118:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1787893152.008980:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893153.038339:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787893153.291968:0:14434:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787893153.291976:0:14434:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9071087e7000 from 7 10000000:01000000:3.0:1787893153.291980:0:14434:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787893153.292027:0:14434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9071013fce00/0x825e3f5022b4b83b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893153.292040:0:14434:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9071013fce00/0x825e3f5022b4b83b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893153.292052:0:14434:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9071013fce00/0x825e3f5022b4b83b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893153.292080:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f31ac154-369d-4473-bca1-5cb1596e1d9c:14434:1874741455584768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787893153.292237:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893153.293473:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff90712c48d600 going to sleep for 11 seconds 00000100:00100000:2.0:1787893153.300718:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455584768 00000100:00100000:2.0:1787893153.300738:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455584768 00000100:00100000:3.0:1787893153.307720:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787893153.307743:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107ff1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+15:14434:x1874741455584768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787893153.307777:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893153.307799:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9071013fde00/0x825e3f5022b4b842 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4b83b expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893153.307849:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9071013fde00/0x825e3f5022b4b842 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4b83b expref: 16 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893153.307862:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9071013fde00/0x825e3f5022b4b842 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4b83b expref: 16 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893153.307891:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071013fde00, rc 0) 00000100:00100000:3.0:1787893153.307986:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107ff1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+16:14434:x1874741455584768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 251us (15748us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893153.307992:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787893153.308011:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f31ac154-369d-4473-bca1-5cb1596e1d9c:14434:1874741455584768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787893153.308028:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9071013fce00/0x825e3f5022b4b83b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b842 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893153.308038:0:14434:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9071013fce00/0x825e3f5022b4b83b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4b842 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893153.308117:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010cdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f31ac154-369d-4473-bca1-5cb1596e1d9c:14434:1874741455584896:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787893153.308159:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893153.308195:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071055ba840 going to sleep for 11 seconds 00000100:00100000:3.0:1787893153.308927:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455584896 00000100:00100000:3.0:1787893153.308935:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455584896 00000100:00100000:3.0:1787893153.309089:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787893153.309098:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107ff3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+16:14434:x1874741455584896:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787893153.309117:0:14432:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787893153.309135:0:14432:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787893153.309139:0:14432:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1787893153.309448:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107ff3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+16:14434:x1874741455584896:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 350us (1287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893153.309457:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787893153.310306:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010cdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f31ac154-369d-4473-bca1-5cb1596e1d9c:14434:1874741455584896:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787893153.310395:0:14434:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787893153.310405:0:14434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9071013fce00/0x825e3f5022b4b83b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b842 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893153.310415:0:14434:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9071013fce00/0x825e3f5022b4b83b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b842 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893154.059118:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893155.081424:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893156.105070:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787893156.565370:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787893156.565378:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787893156.565381:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787893156.565384:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787893156.565695:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874741455585280:0@lo:400:kworker.0 00000100:00100000:1.0:1787893156.565852:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f31ac154-369d-4473-bca1-5cb1596e1d9c:3305:1874741455585024:0@lo:400:kworker.0 00000100:00100000:3.0:1787893156.566002:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874741455585152:0@lo:400:kworker.0 00000100:00100000:1.0:1787893156.566817:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893156.566948:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455585024 00000100:00100000:0.0:1787893156.566957:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455585024 00000100:00100000:0.0:1787893156.567015:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787893156.567025:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907106343450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+16:3305:x1874741455585024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893156.567085:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907106343450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+16:3305:x1874741455585024:12345-0@lo:400:kworker.0 Request processed in 61us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893156.567104:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787893156.567155:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f31ac154-369d-4473-bca1-5cb1596e1d9c:3305:1874741455585024:0@lo:400:kworker.0 00000100:00100000:2.0:1787893156.567679:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893156.569039:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893156.574331:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455585280 00000100:00100000:0.0:1787893156.574351:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455585280 00000100:00100000:0.0:1787893156.574427:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455585152 00000100:00100000:0.0:1787893156.574432:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455585152 00000100:00100000:0.0:1787893156.574472:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787893156.574482:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874741455585280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893156.574593:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e628700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874741455585280:12345-0@lo:400:kworker.0 Request processed in 113us (6915us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893156.574601:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787893156.574619:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787893156.574626:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874741455585152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893156.574660:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874741455585152:12345-0@lo:400:kworker.0 Request processed in 35us (5626us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893156.574666:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787893156.574716:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9070010cd500 x1874741455585280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893156.574733:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874741455585280:0@lo:400:kworker.0 00000100:00080000:2.0:1787893156.575242:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787893156.575897:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9070010cca80 x1874741455585152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893172 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787893156.575919:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874741455585152:0@lo:400:kworker.0 00010000:00010000:2.0:1787893157.129045:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893158.157281:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787893158.872094:0:15485:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg229-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787893159.178089:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893160.207713:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787893160.594491:0:14469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787893161.228805:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787893161.672891:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787893161.672900:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787893161.672902:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787893161.672905:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787893161.672957:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f31ac154-369d-4473-bca1-5cb1596e1d9c:3308:1874741455585408:0@lo:400:kworker.0 00000100:00100000:1.0:1787893161.673036:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893161.673113:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874741455585536:0@lo:400:kworker.0 00000100:00100000:1.0:1787893161.673148:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893161.673167:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787893161.673172:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874741455585664:0@lo:400:kworker.0 00000100:00100000:1.0:1787893161.673194:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893161.673225:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455585408 00000100:00100000:1.0:1787893161.673233:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455585408 00000100:00100000:1.0:1787893161.673295:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787893161.673305:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907106341850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+16:3308:x1874741455585408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893161.673360:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907106341850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+16:3308:x1874741455585408:12345-0@lo:400:kworker.0 Request processed in 56us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893161.673368:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787893161.673407:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455585536 00000100:00100000:1.0:1787893161.673411:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455585536 00000100:00100000:1.0:1787893161.673446:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455585664 00000100:00100000:1.0:1787893161.673449:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455585664 00000100:00100000:1.0:1787893161.673470:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787893161.673476:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070010cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874741455585536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893161.673513:0:14438:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787893161.673525:0:14438:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1787893161.673538:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070010cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874741455585536:12345-0@lo:400:kworker.0 Request processed in 60us (388us total) trans 0 rc 0/0 00000100:00080000:2.0:1787893161.673544:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787893161.673547:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787893161.673564:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787893161.673572:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070010cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874741455585664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893161.673602:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070010cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874741455585664:12345-0@lo:400:kworker.0 Request processed in 32us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893161.673608:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787893161.673744:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9070010cf480 x1874741455585664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893161.673778:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874741455585664:0@lo:400:kworker.0 00010000:00080000:1.0:1787893161.673790:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9070010cfb80 x1874741455585536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893161.673799:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874741455585536:0@lo:400:kworker.0 00000100:00100000:1.0:1787893161.673826:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f31ac154-369d-4473-bca1-5cb1596e1d9c:3308:1874741455585408:0@lo:400:kworker.0 00010000:00010000:0.0:1787893162.252644:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893162.569157:0:3304:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787893147/real 1787893147] req@ffff90712e62b480 x1874741455580800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787893162 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893162.569201:0:3304:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90712e62b480 x1874741455580800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787893162 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787893162.569265:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9071075be800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787893162.569288:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787893162.569292:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e62b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874741455580800:0@lo:8:kworker.0 00000100:00080000:1.0:1787893162.569599:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787893162.569605:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787893162.569608:0:36:0:(import.c:65:import_set_state_nolock()) ffff9071075be800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787893162.569613:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 475 00000100:00080000:1.0:1787893162.569619:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787893162.569626:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9071075be800 using connection 192.168.202.129@tcp/0@lo 00000100:00100000:1.0:1787893162.569647:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9070010cfb80 x1874741455585920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787893162.569674:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787893162.569677:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787893162.569723:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874741455586176:0@lo:400:kworker.0 00000100:00100000:1.0:1787893162.569824:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893162.569902:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455586176 00000100:00100000:1.0:1787893162.569911:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455586176 00000100:00100000:1.0:1787893162.569958:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787893162.569968:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070010cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874741455586176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893162.570018:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070010cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874741455586176:12345-0@lo:400:kworker.0 Request processed in 51us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893162.570025:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787893162.570066:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9070010cdc00 x1874741455586176/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893162.570079:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874741455586176:0@lo:400:kworker.0 00000100:00100000:2.0:1787893162.570402:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f31ac154-369d-4473-bca1-5cb1596e1d9c:3307:1874741455585792:0@lo:400:kworker.0 00000100:00100000:2.0:1787893162.570448:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893162.570483:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787893162.570490:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874741455586048:0@lo:400:kworker.0 00000100:00100000:2.0:1787893162.570519:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893162.570544:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455586048 00000100:00100000:2.0:1787893162.570548:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455586048 00000100:00100000:2.0:1787893162.570575:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787893162.570582:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e62bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874741455586048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893162.570616:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e62bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874741455586048:12345-0@lo:400:kworker.0 Request processed in 35us (96us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893162.570623:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1787893162.570648:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9070010cf480 x1874741455586048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893162.570672:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874741455586048:0@lo:400:kworker.0 00000100:00100000:0.0:1787893162.570793:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874741455585920:0@lo:8:kworker.0 00000100:00100000:0.0:1787893162.570837:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893162.571003:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455585920 00000100:00100000:2.0:1787893162.571007:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455585920 00000100:00100000:2.0:1787893162.571034:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787893162.571039:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90700198d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1874741455585920:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787893162.571066:0:15119:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 490 last 0 00000020:00000080:2.0:1787893162.571097:0:15119:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x825e3f5022b4b849 00002000:00100000:2.0:1787893162.571113:0:15119:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9071184aa000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787893162.571118:0:15119:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1787893162.571121:0:15119:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787893162.571482:0:15119:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787893162.571516:0:15119:0:(import.c:65:import_set_state_nolock()) ffff9071184a8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787893162.571559:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90700198d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1874741455585920:12345-0@lo:8:kworker.0 Request processed in 518us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893162.571566:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787893162.572108:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9070010cfb80 x1874741455585920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787893182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893162.572118:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787893162.572125:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787893162.572144:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787893162.572150:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787893162.572152:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9071075be800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787893162.572177:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787893162.572182:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874741455585920:0@lo:8:kworker.0 00000004:00080000:3.0:1787893162.572338:0:14459:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787893162.572683:0:14459:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 490339929443ns, next at 0ns, rc = 0 00000100:00100000:1.0:1787893162.576176:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455585792 00000100:00100000:1.0:1787893162.576196:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455585792 00000100:00100000:1.0:1787893162.576278:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787893162.576290:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907106342050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+16:3307:x1874741455585792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893162.576392:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907106342050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+16:3307:x1874741455585792:12345-0@lo:400:kworker.0 Request processed in 105us (5943us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893162.576401:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:2.0:1787893162.577844:0:14460:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:2.0:1787893162.577872:0:14460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e62ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14460:1874741455586432:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787893162.577944:0:14460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893162.577970:0:14460:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710714f780 going to sleep for 11 seconds 00000100:00100000:2.0:1787893162.577990:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e62b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455586304:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787893162.578015:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893162.578064:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f31ac154-369d-4473-bca1-5cb1596e1d9c:3307:1874741455585792:0@lo:400:kworker.0 00000100:00100000:1.0:1787893162.579965:0:15121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455586432 00000100:00100000:1.0:1787893162.579979:0:15121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455586432 00000100:00100000:1.0:1787893162.580055:0:15121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787893162.580074:0:15121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e629180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14460:x1874741455586432:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1787893162.582440:0:15121:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1787893162.582456:0:15121:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1787893162.582462:0:15121:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00000100:00100000:3.0:1787893162.583540:0:15122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455586304 00000100:00100000:3.0:1787893162.583564:0:15122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455586304 00000100:00100000:3.0:1787893162.583624:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787893162.583634:0:15122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e62b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874741455586304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787893162.583668:0:15122:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787893162.583797:0:15122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e62b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874741455586304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 164us (5779us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893162.583804:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1787893162.584007:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787893162.584056:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90712e62b800 x1874741455586304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893178 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893162.584089:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e62b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455586304:0@lo:13:osp-pre-0-0.0 00002000:00010000:1.0:1787893162.603050:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787893162.603064:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048f0289e/0x825e3f5022b4b850 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.603082:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=490s v=(0 0) 00010000:00010000:1.0:1787893162.603086:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893162.603093:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048f0289e/0x825e3f5022b4b850 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.603112:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048f0289e/0x825e3f5022b4b850 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.603122:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048f0289e/0x825e3f5022b4b850 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.603130:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048f0289e/0x825e3f5022b4b850 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.603336:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787893162.604629:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787893162.604643:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000662e02ea/0x825e3f5022b4b857 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.604671:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=490s v=(0 0) 00010000:00010000:1.0:1787893162.604675:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893162.604681:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000662e02ea/0x825e3f5022b4b857 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.604694:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000662e02ea/0x825e3f5022b4b857 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.604702:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000662e02ea/0x825e3f5022b4b857 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.604709:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000662e02ea/0x825e3f5022b4b857 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893162.607638:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787893162.607658:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048f0289e/0x825e3f5022b4b850 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893162.607676:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153aa00 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:0.0:1787893162.607681:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048f0289e/0x825e3f5022b4b850 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893162.607694:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048f0289e/0x825e3f5022b4b850 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893162.607746:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048f0289e/0x825e3f5022b4b850 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893162.607778:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048f0289e/0x825e3f5022b4b850 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893162.607821:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787893162.607826:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000662e02ea/0x825e3f5022b4b857 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893162.607832:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153bc00 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:0.0:1787893162.607836:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000662e02ea/0x825e3f5022b4b857 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893162.607844:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000662e02ea/0x825e3f5022b4b857 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893162.607854:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000662e02ea/0x825e3f5022b4b857 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893162.607862:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893162.607864:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893162.607866:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893162.607997:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787893162.608006:0:15121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000662e02ea/0x825e3f5022b4b857 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787893162.609445:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787893162.609457:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd4a15ef/0x825e3f5022b4b85e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.609473:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=490s v=(0 0) 00010000:00010000:1.0:1787893162.609479:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893162.609486:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd4a15ef/0x825e3f5022b4b85e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.609518:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd4a15ef/0x825e3f5022b4b85e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.609529:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd4a15ef/0x825e3f5022b4b85e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.609537:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd4a15ef/0x825e3f5022b4b85e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.609556:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787893162.609570:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893162.609576:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd4a15ef/0x825e3f5022b4b85e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.609584:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153a000 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:1.0:1787893162.609589:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd4a15ef/0x825e3f5022b4b85e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.609597:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd4a15ef/0x825e3f5022b4b85e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.609612:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd4a15ef/0x825e3f5022b4b85e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.609621:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd4a15ef/0x825e3f5022b4b85e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.609652:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893162.609655:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893162.609657:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893162.609863:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787893162.610687:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787893162.610695:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003298ec6/0x825e3f5022b4b865 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.610707:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=490s v=(0 0) 00010000:00010000:1.0:1787893162.610712:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893162.610718:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003298ec6/0x825e3f5022b4b865 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.610730:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003298ec6/0x825e3f5022b4b865 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.610740:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003298ec6/0x825e3f5022b4b865 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.615305:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003298ec6/0x825e3f5022b4b865 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.615364:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787893162.618326:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787893162.618342:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003298ec6/0x825e3f5022b4b865 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893162.618359:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153ac00 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:3.0:1787893162.618365:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003298ec6/0x825e3f5022b4b865 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893162.618376:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003298ec6/0x825e3f5022b4b865 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893162.618405:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003298ec6/0x825e3f5022b4b865 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893162.618411:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003298ec6/0x825e3f5022b4b865 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893162.618442:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893162.618444:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893162.618446:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787893162.619095:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787893162.619105:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b152b258/0x825e3f5022b4b86c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.619129:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=490s v=(0 0) 00010000:00010000:1.0:1787893162.621786:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893162.621806:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b152b258/0x825e3f5022b4b86c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.621839:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b152b258/0x825e3f5022b4b86c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.621851:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b152b258/0x825e3f5022b4b86c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.621860:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b152b258/0x825e3f5022b4b86c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.621887:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787893162.622587:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787893162.622595:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000847664c2/0x825e3f5022b4b873 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.622606:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=490s v=(0 0) 00010000:00010000:1.0:1787893162.622610:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893162.622615:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000847664c2/0x825e3f5022b4b873 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.622627:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000847664c2/0x825e3f5022b4b873 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.622648:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000847664c2/0x825e3f5022b4b873 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.622655:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000847664c2/0x825e3f5022b4b873 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.622672:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787893162.623076:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787893162.623082:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffda83d7/0x825e3f5022b4b87a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.623091:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=490s v=(0 0) 00010000:00010000:1.0:1787893162.623095:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893162.623100:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffda83d7/0x825e3f5022b4b87a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.623109:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffda83d7/0x825e3f5022b4b87a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.623118:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffda83d7/0x825e3f5022b4b87a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.623125:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffda83d7/0x825e3f5022b4b87a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.623144:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1787893162.623540:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787893162.623545:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e200fbc9/0x825e3f5022b4b881 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.623553:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=490s v=(0 0) 00010000:00010000:1.0:1787893162.623556:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893162.623560:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e200fbc9/0x825e3f5022b4b881 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.623568:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e200fbc9/0x825e3f5022b4b881 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.623577:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e200fbc9/0x825e3f5022b4b881 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.623584:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e200fbc9/0x825e3f5022b4b881 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.623592:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1787893162.623986:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787893162.623992:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000793e1aa8/0x825e3f5022b4b888 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.624000:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=490s v=(0 0) 00010000:00010000:1.0:1787893162.624009:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893162.624013:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000793e1aa8/0x825e3f5022b4b888 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.624022:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000793e1aa8/0x825e3f5022b4b888 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.624029:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000793e1aa8/0x825e3f5022b4b888 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.624037:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000793e1aa8/0x825e3f5022b4b888 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.624044:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1787893162.624440:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787893162.624446:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e7f8466/0x825e3f5022b4b88f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.624454:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=490s v=(0 0) 00010000:00010000:1.0:1787893162.624457:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893162.624461:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e7f8466/0x825e3f5022b4b88f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.624469:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e7f8466/0x825e3f5022b4b88f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.624477:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e7f8466/0x825e3f5022b4b88f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.624492:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e7f8466/0x825e3f5022b4b88f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.624501:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1787893162.624897:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787893162.624903:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080926921/0x825e3f5022b4b896 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.624913:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=490s v=(0 0) 00010000:00010000:1.0:1787893162.624916:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893162.624920:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080926921/0x825e3f5022b4b896 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.624927:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080926921/0x825e3f5022b4b896 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.624934:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080926921/0x825e3f5022b4b896 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.624940:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080926921/0x825e3f5022b4b896 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.624948:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:2.0:1787893162.626722:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1787893162.626737:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b152b258/0x825e3f5022b4b86c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893162.626776:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153b000 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:2.0:1787893162.626781:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b152b258/0x825e3f5022b4b86c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893162.626793:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b152b258/0x825e3f5022b4b86c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893162.626828:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b152b258/0x825e3f5022b4b86c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893162.626837:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b152b258/0x825e3f5022b4b86c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893162.626862:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1787893162.626866:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000847664c2/0x825e3f5022b4b873 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893162.626872:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fae00 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:2.0:1787893162.626875:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000847664c2/0x825e3f5022b4b873 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893162.626898:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000847664c2/0x825e3f5022b4b873 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893162.626910:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000847664c2/0x825e3f5022b4b873 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893162.626917:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000847664c2/0x825e3f5022b4b873 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893162.626930:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1787893162.626933:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffda83d7/0x825e3f5022b4b87a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893162.626940:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fa600 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:2.0:1787893162.626943:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffda83d7/0x825e3f5022b4b87a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893162.626950:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffda83d7/0x825e3f5022b4b87a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893162.626959:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffda83d7/0x825e3f5022b4b87a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893162.626966:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffda83d7/0x825e3f5022b4b87a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893162.626988:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787893162.626992:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e200fbc9/0x825e3f5022b4b881 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893162.626999:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fa200 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:2.0:1787893162.627002:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e200fbc9/0x825e3f5022b4b881 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893162.627009:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e200fbc9/0x825e3f5022b4b881 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893162.627019:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e200fbc9/0x825e3f5022b4b881 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893162.627025:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e200fbc9/0x825e3f5022b4b881 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893162.627036:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787893162.627039:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000793e1aa8/0x825e3f5022b4b888 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893162.627045:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fac00 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:2.0:1787893162.627048:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000793e1aa8/0x825e3f5022b4b888 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893162.627065:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000793e1aa8/0x825e3f5022b4b888 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893162.627076:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000793e1aa8/0x825e3f5022b4b888 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893162.627083:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000793e1aa8/0x825e3f5022b4b888 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893162.627097:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787893162.627100:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e7f8466/0x825e3f5022b4b88f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893162.627107:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fb200 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:2.0:1787893162.627110:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e7f8466/0x825e3f5022b4b88f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893162.627118:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e7f8466/0x825e3f5022b4b88f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893162.627127:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e7f8466/0x825e3f5022b4b88f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893162.627144:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e7f8466/0x825e3f5022b4b88f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893162.627171:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787893162.627174:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080926921/0x825e3f5022b4b896 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893162.627181:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fa800 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:2.0:1787893162.627184:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080926921/0x825e3f5022b4b896 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893162.627192:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080926921/0x825e3f5022b4b896 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893162.627202:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080926921/0x825e3f5022b4b896 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893162.627209:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080926921/0x825e3f5022b4b896 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893162.627232:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893162.627234:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893162.627236:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893162.627594:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787893162.633063:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787893162.633082:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001978f1b4/0x825e3f5022b4b89d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.633118:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=490s v=(0 0) 00010000:00010000:1.0:1787893162.633124:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893162.633131:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001978f1b4/0x825e3f5022b4b89d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.633146:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001978f1b4/0x825e3f5022b4b89d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.633158:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001978f1b4/0x825e3f5022b4b89d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.633166:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001978f1b4/0x825e3f5022b4b89d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.633196:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787893162.633865:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893162.633874:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001978f1b4/0x825e3f5022b4b89d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.633884:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421faa00 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:1.0:1787893162.633890:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001978f1b4/0x825e3f5022b4b89d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.633898:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001978f1b4/0x825e3f5022b4b89d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.633933:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001978f1b4/0x825e3f5022b4b89d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.633941:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001978f1b4/0x825e3f5022b4b89d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.633974:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893162.633976:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893162.633978:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787893162.637051:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787893162.637067:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000529c3890/0x825e3f5022b4b8a4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.637088:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=490s v=(0 0) 00010000:00010000:1.0:1787893162.637093:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893162.637099:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000529c3890/0x825e3f5022b4b8a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.637116:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000529c3890/0x825e3f5022b4b8a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.637128:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000529c3890/0x825e3f5022b4b8a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.637137:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000529c3890/0x825e3f5022b4b8a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.637181:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787893162.637200:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893162.637205:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000529c3890/0x825e3f5022b4b8a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.637213:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fbe00 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:1.0:1787893162.637229:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000529c3890/0x825e3f5022b4b8a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.637241:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000529c3890/0x825e3f5022b4b8a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.637265:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000529c3890/0x825e3f5022b4b8a4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.637274:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000529c3890/0x825e3f5022b4b8a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.637294:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893162.637296:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893162.637298:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787893162.637821:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787893162.637828:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2260026/0x825e3f5022b4b8ab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.637836:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=490s v=(0 0) 00010000:00010000:1.0:1787893162.637845:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893162.637849:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2260026/0x825e3f5022b4b8ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.637858:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2260026/0x825e3f5022b4b8ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.637866:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2260026/0x825e3f5022b4b8ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.637873:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2260026/0x825e3f5022b4b8ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.637886:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787893162.637895:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893162.637899:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2260026/0x825e3f5022b4b8ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.637907:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fb400 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:1.0:1787893162.637910:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2260026/0x825e3f5022b4b8ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.637917:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2260026/0x825e3f5022b4b8ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.637926:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2260026/0x825e3f5022b4b8ab lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.637944:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2260026/0x825e3f5022b4b8ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.637959:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893162.637960:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893162.637962:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787893162.638358:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787893162.638363:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f01a69c/0x825e3f5022b4b8b2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.638372:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=490s v=(0 0) 00010000:00010000:1.0:1787893162.638375:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893162.638379:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f01a69c/0x825e3f5022b4b8b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.638387:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f01a69c/0x825e3f5022b4b8b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.638394:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f01a69c/0x825e3f5022b4b8b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.638401:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f01a69c/0x825e3f5022b4b8b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.638415:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787893162.638423:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893162.638432:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f01a69c/0x825e3f5022b4b8b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.638439:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fa000 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:1.0:1787893162.638443:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f01a69c/0x825e3f5022b4b8b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.638450:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f01a69c/0x825e3f5022b4b8b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.638461:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f01a69c/0x825e3f5022b4b8b2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.638467:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f01a69c/0x825e3f5022b4b8b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.638481:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893162.638482:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893162.638484:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787893162.638877:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787893162.638883:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061a2157f/0x825e3f5022b4b8b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.638892:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=490s v=(0 0) 00010000:00010000:1.0:1787893162.638895:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893162.638899:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061a2157f/0x825e3f5022b4b8b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.638921:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061a2157f/0x825e3f5022b4b8b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.638930:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061a2157f/0x825e3f5022b4b8b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.638938:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061a2157f/0x825e3f5022b4b8b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.638952:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787893162.638961:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893162.638965:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061a2157f/0x825e3f5022b4b8b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.638972:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fb600 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:1.0:1787893162.638975:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061a2157f/0x825e3f5022b4b8b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.638983:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061a2157f/0x825e3f5022b4b8b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.638993:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061a2157f/0x825e3f5022b4b8b9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.639001:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061a2157f/0x825e3f5022b4b8b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.639022:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893162.639023:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893162.639025:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787893162.644544:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787893162.644563:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004609cec3/0x825e3f5022b4b8c0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.644582:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=490s v=(0 0) 00010000:00010000:1.0:1787893162.644587:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893162.644594:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004609cec3/0x825e3f5022b4b8c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.644609:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004609cec3/0x825e3f5022b4b8c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.644620:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004609cec3/0x825e3f5022b4b8c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.644628:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004609cec3/0x825e3f5022b4b8c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.644690:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1787893162.645726:0:5870:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:1.0:1787893162.646005:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787893162.646015:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048f0289e/0x825e3f5022b4b8c7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.646040:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=490s v=(0 0) 00010000:00010000:1.0:1787893162.646045:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893162.646050:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048f0289e/0x825e3f5022b4b8c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.646063:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048f0289e/0x825e3f5022b4b8c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.646073:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048f0289e/0x825e3f5022b4b8c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.646081:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048f0289e/0x825e3f5022b4b8c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893162.646478:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787893162.646487:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004609cec3/0x825e3f5022b4b8c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893162.646496:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fa400 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:3.0:1787893162.646502:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004609cec3/0x825e3f5022b4b8c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893162.646513:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004609cec3/0x825e3f5022b4b8c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893162.646532:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004609cec3/0x825e3f5022b4b8c0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893162.646540:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004609cec3/0x825e3f5022b4b8c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893162.646563:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787893162.646566:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048f0289e/0x825e3f5022b4b8c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893162.646573:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153aa00 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:3.0:1787893162.646576:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048f0289e/0x825e3f5022b4b8c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893162.646584:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048f0289e/0x825e3f5022b4b8c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893162.646602:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048f0289e/0x825e3f5022b4b8c7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893162.646610:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893162.646612:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893162.646615:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893162.656005:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787893162.656022:0:15121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048f0289e/0x825e3f5022b4b8c7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787893162.657621:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787893162.657636:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd4a15ef/0x825e3f5022b4b8ce lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.657654:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=490s v=(0 0) 00010000:00010000:1.0:1787893162.657660:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893162.657666:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd4a15ef/0x825e3f5022b4b8ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.657695:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd4a15ef/0x825e3f5022b4b8ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.657705:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd4a15ef/0x825e3f5022b4b8ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.657712:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd4a15ef/0x825e3f5022b4b8ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893162.659552:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787893162.659568:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd4a15ef/0x825e3f5022b4b8ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893162.659584:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153a000 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:2.0:1787893162.659610:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd4a15ef/0x825e3f5022b4b8ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893162.659623:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd4a15ef/0x825e3f5022b4b8ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893162.659648:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd4a15ef/0x825e3f5022b4b8ce lrc: 2/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893162.660920:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893162.660929:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893162.660933:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893162.665921:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787893162.665941:0:15121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd4a15ef/0x825e3f5022b4b8ce lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893162.666372:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787893162.667502:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787893162.667513:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000662e02ea/0x825e3f5022b4b8d5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.667529:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=490s v=(0 0) 00010000:00010000:1.0:1787893162.667533:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893162.667539:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000662e02ea/0x825e3f5022b4b8d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.667552:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000662e02ea/0x825e3f5022b4b8d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.667573:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000662e02ea/0x825e3f5022b4b8d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.667581:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000662e02ea/0x825e3f5022b4b8d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.667645:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787893162.669439:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787893162.669453:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003298ec6/0x825e3f5022b4b8dc lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.669469:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=490s v=(0 0) 00010000:00010000:1.0:1787893162.669474:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893162.669480:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003298ec6/0x825e3f5022b4b8dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.669498:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003298ec6/0x825e3f5022b4b8dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.669508:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003298ec6/0x825e3f5022b4b8dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.669517:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003298ec6/0x825e3f5022b4b8dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893162.680052:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787893162.680069:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000662e02ea/0x825e3f5022b4b8d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893162.680083:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153bc00 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:3.0:1787893162.680088:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000662e02ea/0x825e3f5022b4b8d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893162.680099:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000662e02ea/0x825e3f5022b4b8d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893162.680124:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000662e02ea/0x825e3f5022b4b8d5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893162.680132:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000662e02ea/0x825e3f5022b4b8d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893162.680194:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787893162.680199:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003298ec6/0x825e3f5022b4b8dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893162.680205:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153ac00 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:3.0:1787893162.680208:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003298ec6/0x825e3f5022b4b8dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893162.680226:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003298ec6/0x825e3f5022b4b8dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893162.680238:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003298ec6/0x825e3f5022b4b8dc lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893162.680245:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893162.680247:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893162.680250:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893162.684049:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787893162.684066:0:15121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003298ec6/0x825e3f5022b4b8dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787893162.685686:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787893162.685698:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2de2ee7/0x825e3f5022b4b8e3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893162.685715:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=490s v=(0 0) 00010000:00010000:2.0:1787893162.685720:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893162.685727:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2de2ee7/0x825e3f5022b4b8e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893162.685743:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2de2ee7/0x825e3f5022b4b8e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893162.685792:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2de2ee7/0x825e3f5022b4b8e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893162.685800:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2de2ee7/0x825e3f5022b4b8e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893162.688989:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787893162.689007:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2de2ee7/0x825e3f5022b4b8e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893162.689020:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9ee00 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:3.0:1787893162.689026:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2de2ee7/0x825e3f5022b4b8e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893162.689062:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2de2ee7/0x825e3f5022b4b8e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893162.689087:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2de2ee7/0x825e3f5022b4b8e3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893162.689183:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893162.689186:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893162.689195:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893162.690186:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893162.690325:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787893162.690335:0:15121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2de2ee7/0x825e3f5022b4b8e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787893162.695485:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787893162.695503:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fdeefc8/0x825e3f5022b4b8ea lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893162.695527:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=490s v=(0 0) 00010000:00010000:0.0:1787893162.695535:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787893162.695543:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fdeefc8/0x825e3f5022b4b8ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893162.695562:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fdeefc8/0x825e3f5022b4b8ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893162.695574:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fdeefc8/0x825e3f5022b4b8ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893162.695582:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fdeefc8/0x825e3f5022b4b8ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893162.695615:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787893162.695866:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893162.695873:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fdeefc8/0x825e3f5022b4b8ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.695881:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc8e00 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:1.0:1787893162.695885:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fdeefc8/0x825e3f5022b4b8ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.695894:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fdeefc8/0x825e3f5022b4b8ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.695913:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fdeefc8/0x825e3f5022b4b8ea lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.695920:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fdeefc8/0x825e3f5022b4b8ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.695940:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893162.695942:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893162.695944:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787893162.696418:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787893162.696425:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce5c6b05/0x825e3f5022b4b8f1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893162.696434:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=490s v=(0 0) 00010000:00010000:0.0:1787893162.696438:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787893162.696442:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce5c6b05/0x825e3f5022b4b8f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893162.696465:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce5c6b05/0x825e3f5022b4b8f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893162.696474:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce5c6b05/0x825e3f5022b4b8f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893162.696481:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce5c6b05/0x825e3f5022b4b8f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893162.696544:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787893162.697108:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787893162.697115:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f87e579d/0x825e3f5022b4b8f8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893162.697125:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=490s v=(0 0) 00010000:00010000:0.0:1787893162.697128:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787893162.697133:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f87e579d/0x825e3f5022b4b8f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893162.697143:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f87e579d/0x825e3f5022b4b8f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893162.697151:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f87e579d/0x825e3f5022b4b8f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893162.697168:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f87e579d/0x825e3f5022b4b8f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893162.699367:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787893162.699384:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce5c6b05/0x825e3f5022b4b8f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893162.699399:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc8400 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:3.0:1787893162.699405:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce5c6b05/0x825e3f5022b4b8f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893162.699416:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce5c6b05/0x825e3f5022b4b8f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893162.699437:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce5c6b05/0x825e3f5022b4b8f1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893162.699445:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce5c6b05/0x825e3f5022b4b8f1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893162.699478:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787893162.699500:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f87e579d/0x825e3f5022b4b8f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893162.699507:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc8000 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:3.0:1787893162.699511:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f87e579d/0x825e3f5022b4b8f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893162.699518:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f87e579d/0x825e3f5022b4b8f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893162.699527:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f87e579d/0x825e3f5022b4b8f8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893162.699534:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893162.699536:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893162.699538:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893162.704121:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787893162.704142:0:15121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f87e579d/0x825e3f5022b4b8f8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787893162.704932:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787893162.704942:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d033154/0x825e3f5022b4b8ff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893162.704957:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=490s v=(0 0) 00010000:00010000:0.0:1787893162.704963:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787893162.704969:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d033154/0x825e3f5022b4b8ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893162.704984:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d033154/0x825e3f5022b4b8ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893162.704995:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d033154/0x825e3f5022b4b8ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893162.705002:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d033154/0x825e3f5022b4b8ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.711974:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893162.712010:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d033154/0x825e3f5022b4b8ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.712025:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc9a00 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:1.0:1787893162.712031:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d033154/0x825e3f5022b4b8ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.712042:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d033154/0x825e3f5022b4b8ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.712068:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d033154/0x825e3f5022b4b8ff lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.712081:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893162.712083:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893162.712085:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893162.714025:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787893162.714044:0:15121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d033154/0x825e3f5022b4b8ff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787893162.715111:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787893162.715122:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040735ba5/0x825e3f5022b4b906 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893162.715138:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=490s v=(0 0) 00010000:00010000:0.0:1787893162.715143:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787893162.715150:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040735ba5/0x825e3f5022b4b906 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893162.715165:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040735ba5/0x825e3f5022b4b906 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893162.715175:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040735ba5/0x825e3f5022b4b906 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893162.715184:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040735ba5/0x825e3f5022b4b906 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893162.715202:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787893162.715674:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787893162.715681:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052712de6/0x825e3f5022b4b90d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893162.715696:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=490s v=(0 0) 00010000:00010000:0.0:1787893162.715700:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787893162.715705:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052712de6/0x825e3f5022b4b90d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893162.715714:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052712de6/0x825e3f5022b4b90d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893162.715722:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052712de6/0x825e3f5022b4b90d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893162.715729:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052712de6/0x825e3f5022b4b90d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893162.715737:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787893162.716487:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787893162.716500:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040735ba5/0x825e3f5022b4b906 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.716511:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc8200 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:1.0:1787893162.716516:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040735ba5/0x825e3f5022b4b906 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.716526:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040735ba5/0x825e3f5022b4b906 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.716546:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040735ba5/0x825e3f5022b4b906 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.716567:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040735ba5/0x825e3f5022b4b906 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.716593:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893162.716597:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052712de6/0x825e3f5022b4b90d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.716603:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc9000 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:1.0:1787893162.716606:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052712de6/0x825e3f5022b4b90d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.716615:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052712de6/0x825e3f5022b4b90d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.716625:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052712de6/0x825e3f5022b4b90d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.716633:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052712de6/0x825e3f5022b4b90d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893162.716645:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893162.716647:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893162.716649:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893162.716775:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1787893162.717712:0:15121:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:0.0:1787893162.718561:0:15121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e629180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14460:x1874741455586432:12345-0@lo:5:osp-pre-0-0.0 Request processed in 138481us (140608us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893162.718577:0:15121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787893162.718710:0:14460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e62ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14460:1874741455586432:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787893162.718727:0:14460:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:1.0:1787893162.718858:0:14460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010cdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14460:1874741455586560:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787893162.718897:0:14460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893162.718941:0:14460:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071055ba0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787893162.719287:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455586560 00000100:00100000:0.0:1787893162.719299:0:15120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455586560 00000100:00100000:0.0:1787893162.719353:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787893162.719363:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070010cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14460:x1874741455586560:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1787893162.719409:0:15120:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:0.0:1787893162.731445:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070010cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14460:x1874741455586560:12345-0@lo:5:osp-pre-0-0.0 Request processed in 12074us (12538us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787893162.731473:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787893162.734636:0:14460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010cdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14460:1874741455586560:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787893162.734661:0:14460:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:0.0:1787893163.272936:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893163.597324:0:3304:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787893148/real 1787893148] req@ffff90712e629500 x1874741455581568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787893163 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893163.597364:0:3304:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90712e629500 x1874741455581568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787893163 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787893163.597387:0:3304:0:(import.c:65:import_set_state_nolock()) ffff907105a71800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787893163.597409:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787893163.597413:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e629500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874741455581568:0@lo:8:kworker.0 00000100:00080000:0.0:1787893163.597535:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787893163.597539:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787893163.597543:0:36:0:(import.c:65:import_set_state_nolock()) ffff907105a71800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787893163.597549:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 476 00000100:00080000:0.0:1787893163.597554:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787893163.597563:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff907105a71800 using connection 192.168.202.129@tcp/0@lo 00000100:00100000:0.0:1787893163.597585:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90700198fb80 x1874741455586944/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787893163.597611:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700198fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874741455586944:0@lo:8:kworker.0 00000100:00100000:0.0:1787893163.597688:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893163.597783:0:15121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455586944 00000100:00100000:0.0:1787893163.597800:0:15121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455586944 00000100:00100000:0.0:1787893163.597841:0:15121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787893163.597849:0:15121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90700198c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3304:x1874741455586944:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787893163.597868:0:15121:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787893163.597912:0:15121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90700198c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3304:x1874741455586944:12345-0@lo:8:kworker.0 Request processed in 63us (224us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787893163.597919:0:15121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787893163.597953:0:3304:0:(import.c:65:import_set_state_nolock()) ffff907105a71800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787893163.597957:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787893163.597959:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700198fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874741455586944:0@lo:8:kworker.0 00000100:00100000:0.0:1787893163.597999:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787893163.598022:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700198fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874741455587072:0@lo:400:kworker.0 00000100:00100000:0.0:1787893163.598050:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893163.598080:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455587072 00000100:00100000:0.0:1787893163.598084:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455587072 00000100:00100000:0.0:1787893163.598118:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787893163.598126:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90700198ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874741455587072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893163.598168:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90700198ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874741455587072:12345-0@lo:400:kworker.0 Request processed in 44us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893163.598174:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1787893163.598202:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90700198fb80 x1874741455587072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893163.598213:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700198fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874741455587072:0@lo:400:kworker.0 00000100:00100000:0.0:1787893163.598239:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700198fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874741455587200:0@lo:400:kworker.0 00000100:00100000:0.0:1787893163.598272:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893163.598299:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455587200 00000100:00100000:0.0:1787893163.598305:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455587200 00000100:00100000:0.0:1787893163.598339:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787893163.598346:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90700198d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874741455587200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893163.598380:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90700198d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874741455587200:12345-0@lo:400:kworker.0 Request processed in 35us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893163.598386:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1787893163.598402:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787893163.598424:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90700198fb80 x1874741455587200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893163.598433:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700198fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874741455587200:0@lo:400:kworker.0 00000100:00100000:1.0:1787893163.598653:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700198e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f31ac154-369d-4473-bca1-5cb1596e1d9c:3307:1874741455586688:0@lo:400:kworker.0 00000100:00100000:1.0:1787893163.598695:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893163.598729:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787893163.598735:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700198f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455586816:0@lo:400:kworker.0 00000100:00100000:1.0:1787893163.598785:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893163.600323:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455586816 00000100:00100000:3.0:1787893163.600335:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455586816 00000100:00100000:3.0:1787893163.600383:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787893163.600394:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070010cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1874741455586816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893163.600465:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070010cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1874741455586816:12345-0@lo:400:kworker.0 Request processed in 73us (1679us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893163.600473:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787893163.600517:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700198f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455586816:0@lo:400:kworker.0 00000100:00100000:0.0:1787893163.606085:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455586688 00000100:00100000:0.0:1787893163.606107:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455586688 00000100:00100000:0.0:1787893163.606180:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787893163.606189:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907106341c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+16:3307:x1874741455586688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893163.606310:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907106341c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+16:3307:x1874741455586688:12345-0@lo:400:kworker.0 Request processed in 121us (7612us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893163.606317:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787893163.606395:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700198e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f31ac154-369d-4473-bca1-5cb1596e1d9c:3307:1874741455586688:0@lo:400:kworker.0 00010000:00010000:3.0:1787893164.304328:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893165.337618:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787893166.184522:0:15835:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787893166.184527:0:15835:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1787893166.184641:0:15835:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff907113d05800 00000020:01000004:0.0:1787893166.184660:0:15835:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1787893166.184673:0:15835:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1787893166.184687:0:15835:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff907105a899b8) 00000020:00000080:0.0:1787893166.184710:0:15835:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787893166.224714:0:15835:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787893166.225018:0:15835:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787893166.227065:0:15835:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787893166.227411:0:15835:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787893166.227659:0:15835:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787893166.228193:0:15835:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 233: rc = 0 00100000:10000000:2.0:1787893166.228725:0:15835:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 233: rc = 0 00100000:10000000:2.0:1787893166.228861:0:15835:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 233: rc = 0 00100000:10000000:2.0:1787893166.230041:0:15835:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 555: rc = 0 00100000:10000000:2.0:1787893166.230448:0:15835:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 555: rc = 0 00100000:10000000:2.0:1787893166.230684:0:15835:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 555: rc = 0 00100000:10000000:2.0:1787893166.230961:0:15835:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 555: rc = 0 00100000:10000000:2.0:1787893166.231216:0:15835:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 555: rc = 0 00100000:10000000:2.0:1787893166.231686:0:15835:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 555: rc = 0 00000020:00000080:2.0:1787893166.232500:0:15835:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787893166.232515:0:15835:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787893166.232528:0:15835:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x825e3f5022b4b91b 00000020:01000004:2.0:1787893166.232537:0:15835:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1787893166.232561:0:15835:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.129@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787893166.232564:0:15835:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787893166.232571:0:15835:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787893166.232606:0:15835:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1787893166.232612:0:15835:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.129@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787893166.251497:0:15835:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.129@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787893166.251548:0:15835:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.129@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1787893166.251552:0:15835:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787893166.251554:0:15835:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787893166.251555:0:15835:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787893166.251557:0:15835:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787893166.251558:0:15835:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787893166.251559:0:15835:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787893166.251561:0:15835:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787893166.251562:0:15835:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787893166.251563:0:15835:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787893166.251567:0:15835:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1787893166.251569:0:15835:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787893166.251571:0:15835:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787893166.251572:0:15835:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787893166.251573:0:15835:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787893166.251573:0:15835:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787893166.251574:0:15835:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787893166.251575:0:15835:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787893166.251576:0:15835:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787893166.251577:0:15835:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787893166.251606:0:15835:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787893166.251627:0:15835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e62b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15835:1874741455587328:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787893166.251709:0:15835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893166.254010:0:15835:0:(client.c:2715:ptlrpc_set_wait()) set ffff90711b970480 going to sleep for 11 seconds 00000100:00100000:0.0:1787893166.255986:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455587328 00000100:00100000:0.0:1787893166.256001:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455587328 00000100:00100000:0.0:1787893166.256382:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787893166.256392:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907106340050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+16:15835:x1874741455587328:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787893166.256451:0:14432:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787893166.256455:0:14432:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1787893166.256458:0:14432:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1787893166.282918:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907106340050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+16:15835:x1874741455587328:12345-0@lo:253:mount.lustre.0 Request processed in 26519us (31201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893166.282933:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787893166.283412:0:15835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e62b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15835:1874741455587328:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787893166.283440:0:15835:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787893166.283444:0:15835:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787893166.283446:0:15835:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787893166.283447:0:15835:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787893166.283449:0:15835:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787893166.283450:0:15835:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787893166.283452:0:15835:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787893166.283454:0:15835:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787893166.283456:0:15835:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787893166.283457:0:15835:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787893166.283477:0:15835:0:(tgt_mount.c:101:server_register_mount()) register mount ffff907113d05800 from lustre-OST0001 10000000:01000000:3.0:1787893166.283504:0:15835:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787893166.283507:0:15835:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787893166.283515:0:15835:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff907105a8cd28 local copy 00010000:00010000:3.0:1787893166.283526:0:15835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff907139b9fe00/0x825e3f5022b4b6c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b6c8 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893166.284002:0:15835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15835:1874741455587456:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787893166.284054:0:15835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893166.284403:0:15835:0:(client.c:2715:ptlrpc_set_wait()) set ffff90711031ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1787893166.286136:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455587456 00000100:00100000:1.0:1787893166.286151:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455587456 00000100:00100000:1.0:1787893166.286312:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787893166.286323:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907106342850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+16:15835:x1874741455587456:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787893166.286590:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907106342850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+16:15835:x1874741455587456:12345-0@lo:501:mount.lustre.0 Request processed in 268us (2534us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787893166.286598:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787893166.286748:0:15835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15835:1874741455587456:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787893166.286800:0:15835:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787893166.286952:0:15835:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787893166.286961:0:15835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff907139b9fe00/0x825e3f5022b4b6c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b6c8 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893166.286973:0:15835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff907139b9fe00/0x825e3f5022b4b6c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b6c8 expref: -99 pid: 14418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787893166.286997:0:15835:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff907113d05800 10000000:01000000:3.0:1787893166.287006:0:15835:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787893166.287011:0:15835:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787893166.287014:0:15835:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787893166.287019:0:15835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1787893166.287022:0:15835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787893166.287052:0:15835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff907104f46600/0x825e3f5022b4b922 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893166.287061:0:15835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff907104f46600/0x825e3f5022b4b922 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893166.287071:0:15835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff907104f46600/0x825e3f5022b4b922 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893166.287089:0:15835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15835:1874741455587584:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787893166.287133:0:15835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893166.287315:0:15835:0:(client.c:2715:ptlrpc_set_wait()) set ffff90711031ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1787893166.287400:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455587584 00000100:00100000:2.0:1787893166.287405:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455587584 00000100:00100000:2.0:1787893166.287430:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787893166.287437:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907106340c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+16:15835:x1874741455587584:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787893166.287446:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893166.287458:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907139b9e000/0x825e3f5022b4b929 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4b922 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893166.287490:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907139b9e000/0x825e3f5022b4b929 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4b922 expref: 17 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893166.287501:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907139b9e000/0x825e3f5022b4b929 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4b922 expref: 17 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893166.287510:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9e000, rc 0) 00000100:00100000:2.0:1787893166.287590:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907106340c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+17:15835:x1874741455587584:12345-0@lo:101:mount.lustre.0 Request processed in 151us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893166.287596:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787893166.287773:0:15835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15835:1874741455587584:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787893166.287788:0:15835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff907104f46600/0x825e3f5022b4b922 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b929 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893166.287797:0:15835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff907104f46600/0x825e3f5022b4b922 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4b929 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787893166.288514:0:15835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1787893166.289738:0:15835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787893166.290321:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1787893166.290369:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1787893166.295412:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1787893166.295521:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1787893166.295562:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1787893166.295598:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1787893166.296491:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1787893166.296504:0:15835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1787893166.297777:0:15835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e62b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15835:1874741455587712:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787893166.297860:0:15835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893166.297902:0:15835:0:(client.c:2715:ptlrpc_set_wait()) set ffff90711b9706c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787893166.298296:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455587712 00000100:00100000:0.0:1787893166.298305:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455587712 00000100:00100000:0.0:1787893166.298349:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787893166.298359:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907106343850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+17:15835:x1874741455587712:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787893166.298787:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907106343850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+17:15835:x1874741455587712:12345-0@lo:501:mount.lustre.0 Request processed in 428us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893166.298807:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787893166.298958:0:15835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e62b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15835:1874741455587712:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787893166.299002:0:15835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15835:1874741455587840:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787893166.299054:0:15835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893166.299083:0:15835:0:(client.c:2715:ptlrpc_set_wait()) set ffff907121322540 going to sleep for 11 seconds 00000100:00100000:0.0:1787893166.299745:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455587840 00000100:00100000:0.0:1787893166.299785:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455587840 00000100:00100000:0.0:1787893166.299828:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787893166.299836:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907106340850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+17:15835:x1874741455587840:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787893166.300159:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907106340850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+17:15835:x1874741455587840:12345-0@lo:503:mount.lustre.0 Request processed in 323us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893166.300167:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787893166.300308:0:15835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15835:1874741455587840:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787893166.303050:0:15835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787893166.303143:0:15835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15835:1874741455587968:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787893166.303378:0:15835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893166.303465:0:15835:0:(client.c:2715:ptlrpc_set_wait()) set ffff907124dce540 going to sleep for 11 seconds 00000100:00100000:0.0:1787893166.303741:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455587968 00000100:00100000:0.0:1787893166.303749:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455587968 00000100:00100000:0.0:1787893166.303896:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787893166.303907:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907106341050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+17:15835:x1874741455587968:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787893166.304126:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907106341050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+17:15835:x1874741455587968:12345-0@lo:502:mount.lustre.0 Request processed in 220us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893166.304134:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787893166.304217:0:15835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15835:1874741455587968:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787893166.304482:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1787893166.304531:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1787893166.304567:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1787893166.304617:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1787893166.304657:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1787893166.304693:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1787893166.304743:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1787893166.304804:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1787893166.304850:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1787893166.304880:0:15835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15835:1874741455588096:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787893166.304925:0:15835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893166.305590:0:15835:0:(client.c:2715:ptlrpc_set_wait()) set ffff907121322540 going to sleep for 11 seconds 00000100:00100000:1.0:1787893166.305656:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455588096 00000100:00100000:1.0:1787893166.305663:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455588096 00000100:00100000:1.0:1787893166.305697:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787893166.305705:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907106340450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+17:15835:x1874741455588096:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787893166.305904:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907106340450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+17:15835:x1874741455588096:12345-0@lo:502:mount.lustre.0 Request processed in 198us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893166.305911:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787893166.306006:0:15835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15835:1874741455588096:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787893166.306088:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1787893166.306100:0:15835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1787893166.309601:0:15838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787893166.309615:0:15838:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1787893166.309622:0:15838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787893166.309624:0:15838:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787893166.309647:0:15838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787893166.309674:0:15838:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9070020b0000) 00000020:00000080:3.0:1787893166.309706:0:15838:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787893166.309713:0:15838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787893166.309889:0:15838:0:(tgt_mount.c:153:server_get_mount()) get mount ffff907113d05800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787893166.309898:0:15838:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787893166.309906:0:15838:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x825e3f5022b4b937 00010000:00010000:3.0:1787893166.317597:0:15838:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1787893166.318362:0:15838:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1787893166.320414:0:15838:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1787893166.324609:0:15838:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1787893166.324622:0:15838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787893166.324628:0:15838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893166.324631:0:15838:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1787893166.324635:0:15838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787893166.324639:0:15838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893166.324641:0:15838:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787893166.324643:0:15838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787893166.324645:0:15838:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787893166.324648:0:15838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787893166.324650:0:15838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893166.324652:0:15838:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787893166.324654:0:15838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787893166.324657:0:15838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893166.324658:0:15838:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787893166.324662:0:15838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787893166.324730:0:15838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787893166.324734:0:15838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787893166.324735:0:15838:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787893166.324739:0:15838:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1787893166.329194:0:15835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1787893166.329250:0:15835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787893166.329272:0:15835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff907104f46600/0x825e3f5022b4b922 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b929 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893166.329284:0:15835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff907104f46600/0x825e3f5022b4b922 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b929 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787893166.329292:0:15835:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff907113d05800 from 1 10000000:01000000:3.0:1787893166.329295:0:15835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787893166.329332:0:15835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff907104f47000/0x825e3f5022b4b93e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893166.329339:0:15835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff907104f47000/0x825e3f5022b4b93e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893166.329350:0:15835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff907104f47000/0x825e3f5022b4b93e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893166.329374:0:15835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15835:1874741455588224:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787893166.329453:0:15835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893166.329510:0:15835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071055ba300 going to sleep for 11 seconds 00000100:00100000:0.0:1787893166.329612:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455588224 00000100:00100000:0.0:1787893166.329620:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455588224 00000100:00100000:0.0:1787893166.329676:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787893166.329685:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907106343050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+17:15835:x1874741455588224:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787893166.329700:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893166.329713:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907137fc8600/0x825e3f5022b4b945 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4b93e expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893166.329736:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907137fc8600/0x825e3f5022b4b945 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4b93e expref: 18 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893166.329747:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907137fc8600/0x825e3f5022b4b945 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4b93e expref: 18 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893166.329793:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907137fc8600, rc 0) 00000100:00100000:0.0:1787893166.329830:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907106343050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+18:15835:x1874741455588224:12345-0@lo:101:mount.lustre.0 Request processed in 146us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893166.329837:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787893166.330201:0:15835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15835:1874741455588224:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787893166.330218:0:15835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff907104f47000/0x825e3f5022b4b93e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b945 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893166.330236:0:15835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff907104f47000/0x825e3f5022b4b93e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4b945 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787893166.330817:0:15835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1787893166.331270:0:15835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787893166.331518:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1787893166.331563:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1787893166.331640:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1787893166.331649:0:15835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1787893166.331714:0:15835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15835:1874741455588352:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787893166.331795:0:15835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893166.331834:0:15835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071055ba300 going to sleep for 11 seconds 00000100:00100000:0.0:1787893166.331987:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455588352 00000100:00100000:0.0:1787893166.331994:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455588352 00000100:00100000:0.0:1787893166.332039:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787893166.332049:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90711b76b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+18:15835:x1874741455588352:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787893166.332269:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90711b76b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+18:15835:x1874741455588352:12345-0@lo:501:mount.lustre.0 Request processed in 220us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893166.332277:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787893166.336059:0:15835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15835:1874741455588352:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787893166.336125:0:15835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15835:1874741455588480:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787893166.336273:0:15835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893166.336483:0:15835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071055ba300 going to sleep for 11 seconds 00000100:00100000:0.0:1787893166.336649:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455588480 00000100:00100000:0.0:1787893166.336657:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455588480 00000100:00100000:0.0:1787893166.336744:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787893166.336790:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90711b769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+18:15835:x1874741455588480:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787893166.336983:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90711b769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+18:15835:x1874741455588480:12345-0@lo:503:mount.lustre.0 Request processed in 229us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893166.336991:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787893166.337077:0:15835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15835:1874741455588480:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787893166.337610:0:15835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787893166.337676:0:15835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15835:1874741455588608:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787893166.337718:0:15835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893166.338112:0:15835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071055ba300 going to sleep for 11 seconds 00000100:00100000:2.0:1787893166.338543:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455588608 00000100:00100000:2.0:1787893166.338551:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455588608 00000100:00100000:2.0:1787893166.338589:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787893166.338599:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90711b76b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+18:15835:x1874741455588608:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787893166.338849:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90711b76b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+18:15835:x1874741455588608:12345-0@lo:502:mount.lustre.0 Request processed in 250us (1129us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893166.338866:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787893166.338962:0:15835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15835:1874741455588608:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787893166.339375:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787893166.339433:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787893166.339481:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787893166.339519:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787893166.339567:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787893166.339618:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787893166.339655:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787893166.339690:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1787893166.339726:0:15835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15835:1874741455588736:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787893166.339818:0:15835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893166.339849:0:15835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071055ba300 going to sleep for 11 seconds 00000100:00100000:0.0:1787893166.339918:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455588736 00000100:00100000:0.0:1787893166.339924:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455588736 00000100:00100000:0.0:1787893166.339955:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787893166.339963:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907119794050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+18:15835:x1874741455588736:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787893166.340109:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907119794050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+18:15835:x1874741455588736:12345-0@lo:502:mount.lustre.0 Request processed in 145us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893166.340117:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787893166.340488:0:15835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15835:1874741455588736:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787893166.340593:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787893166.340603:0:15835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1787893166.341627:0:15842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787893166.341639:0:15842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787893166.341642:0:15842:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787893166.341648:0:15842:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff907113d05800 00000020:00000080:3.0:1787893166.341650:0:15842:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787893166.341658:0:15842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787893166.341661:0:15842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787893166.341662:0:15842:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787893166.341665:0:15842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787893166.341667:0:15842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787893166.341668:0:15842:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787893166.341671:0:15842:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff907113d05800 00000020:00000080:3.0:1787893166.341673:0:15842:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787893166.341867:0:15842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787893166.341872:0:15842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787893166.341873:0:15842:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787893166.341876:0:15842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787893166.341887:0:15842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787893166.341889:0:15842:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787893166.341893:0:15842:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff907113d05800 00000020:00000080:3.0:1787893166.341895:0:15842:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00010000:00010000:3.0:1787893166.357838:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787893166.357977:0:15842:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787893166.357990:0:15842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787893166.357992:0:15842:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787893166.357997:0:15842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1787893166.365870:0:15835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1787893166.365920:0:15835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787893166.365947:0:15835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff907104f47000/0x825e3f5022b4b93e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b945 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893166.365962:0:15835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff907104f47000/0x825e3f5022b4b93e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b945 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787893166.366017:0:15835:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787893166.366021:0:15835:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff907113d05800 10000000:01000000:3.0:1787893166.366024:0:15835:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff907113d05800 10000000:01000000:3.0:1787893166.366028:0:15835:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787893166.366034:0:15835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff907113d05800 from 1 10000000:01000000:3.0:1787893166.366038:0:15835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787893166.366076:0:15835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff907104f46e00/0x825e3f5022b4b94c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893166.366086:0:15835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff907104f46e00/0x825e3f5022b4b94c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893166.366097:0:15835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff907104f46e00/0x825e3f5022b4b94c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893166.366124:0:15835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15835:1874741455588864:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787893166.366318:0:15835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893166.366398:0:15835:0:(client.c:2715:ptlrpc_set_wait()) set ffff90711803d540 going to sleep for 11 seconds 00000100:00100000:0.0:1787893166.373968:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455588864 00000100:00100000:0.0:1787893166.373984:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455588864 00000100:00100000:0.0:1787893166.374038:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787893166.374049:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907119795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+18:15835:x1874741455588864:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787893166.374065:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893166.374083:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907137fc8c00/0x825e3f5022b4b953 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4b94c expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893166.374112:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907137fc8c00/0x825e3f5022b4b953 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4b94c expref: 19 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893166.374124:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907137fc8c00/0x825e3f5022b4b953 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4b94c expref: 19 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893166.374133:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907137fc8c00, rc 0) 00000100:00100000:0.0:1787893166.374242:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907119795850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+19:15835:x1874741455588864:12345-0@lo:101:mount.lustre.0 Request processed in 194us (7925us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893166.374249:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787893166.374500:0:15835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15835:1874741455588864:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787893166.374520:0:15835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff907104f46e00/0x825e3f5022b4b94c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b953 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893166.374530:0:15835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff907104f46e00/0x825e3f5022b4b94c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4b953 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787893166.378841:0:15835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1787893166.380467:0:15835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787893166.381641:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787893166.381712:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1787893166.383486:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1787893166.383623:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1787893166.383664:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1787893166.383714:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1787893166.383749:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1787893166.383813:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1787893166.383860:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1787893166.383894:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1787893166.383926:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1787893166.383970:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1787893166.384005:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1787893166.384038:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1787893166.384087:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1787893166.384125:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1787893166.384196:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1787893166.384262:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1787893166.384313:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1787893166.384355:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1787893166.384404:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1787893166.384438:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1787893166.384472:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1787893166.384522:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1787893166.384558:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1787893166.384594:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1787893166.384644:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1787893166.384681:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1787893166.384718:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1787893166.384796:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1787893166.384835:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1787893166.384870:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1787893166.384928:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1787893166.384977:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1787893166.385012:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1787893166.385078:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1787893166.385116:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1787893166.385209:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1787893166.385217:0:15835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1787893166.385339:0:15835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e629500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15835:1874741455588992:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787893166.385414:0:15835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893166.385465:0:15835:0:(client.c:2715:ptlrpc_set_wait()) set ffff907111b69000 going to sleep for 11 seconds 00000100:00100000:3.0:1787893166.385966:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455588992 00000100:00100000:3.0:1787893166.385975:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455588992 00000100:00100000:3.0:1787893166.386024:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787893166.386033:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907119795450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+19:15835:x1874741455588992:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787893166.386329:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907119795450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+19:15835:x1874741455588992:12345-0@lo:501:mount.lustre.0 Request processed in 296us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893166.386338:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787893166.388871:0:15835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e629500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15835:1874741455588992:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787893166.388936:0:15835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15835:1874741455589120:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787893166.389009:0:15835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893166.391267:0:15835:0:(client.c:2715:ptlrpc_set_wait()) set ffff90712118b180 going to sleep for 11 seconds 00000100:00100000:0.0:1787893166.392476:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455589120 00000100:00100000:0.0:1787893166.392488:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455589120 00000100:00100000:0.0:1787893166.392582:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787893166.392594:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137bc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+19:15835:x1874741455589120:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787893166.392855:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137bc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+19:15835:x1874741455589120:12345-0@lo:503:mount.lustre.0 Request processed in 264us (3846us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893166.392864:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787893166.393078:0:15835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15835:1874741455589120:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787893166.394465:0:15835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787893166.394553:0:15835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15835:1874741455589248:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787893166.394622:0:15835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893166.394679:0:15835:0:(client.c:2715:ptlrpc_set_wait()) set ffff907110297540 going to sleep for 11 seconds 00000100:00100000:0.0:1787893166.395272:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455589248 00000100:00100000:0.0:1787893166.395280:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455589248 00000100:00100000:0.0:1787893166.395336:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787893166.395346:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137bc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+19:15835:x1874741455589248:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787893166.395580:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137bc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+19:15835:x1874741455589248:12345-0@lo:502:mount.lustre.0 Request processed in 234us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893166.395589:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787893166.396136:0:15835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15835:1874741455589248:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787893166.396617:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787893166.396675:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1787893166.396708:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1787893166.396784:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1787893166.396826:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1787893166.396877:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1787893166.396914:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1787893166.396949:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1787893166.396999:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787893166.397036:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1787893166.397068:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1787893166.397120:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1787893166.397157:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1787893166.400622:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1787893166.400791:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1787893166.400832:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1787893166.400864:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1787893166.400911:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1787893166.400945:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1787893166.400976:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1787893166.401021:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1787893166.401054:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1787893166.401085:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1787893166.401132:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1787893166.401166:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1787893166.402047:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1787893166.402118:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1787893166.402158:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1787893166.402432:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1787893166.402489:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1787893166.402529:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1787893166.402580:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1787893166.402611:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1787893166.402661:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1787893166.402719:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1787893166.402910:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1787893166.402949:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1787893166.402984:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1787893166.403034:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1787893166.403069:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1787893166.403122:0:15835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010cc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15835:1874741455589376:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787893166.403285:0:15835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893166.403439:0:15835:0:(client.c:2715:ptlrpc_set_wait()) set ffff90712f9e9240 going to sleep for 11 seconds 00000100:00100000:2.0:1787893166.403481:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455589376 00000100:00100000:2.0:1787893166.403489:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455589376 00000100:00100000:2.0:1787893166.403577:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787893166.403588:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137bc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+19:15835:x1874741455589376:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787893166.403854:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137bc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+19:15835:x1874741455589376:12345-0@lo:502:mount.lustre.0 Request processed in 266us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893166.403861:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787893166.403978:0:15835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010cc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15835:1874741455589376:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787893166.404062:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1787893166.404073:0:15835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1787893166.405697:0:15847:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787893166.405712:0:15847:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff90712ebc8000) 00000020:00000080:2.0:1787893166.405733:0:15847:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1787893166.406030:0:15847:0:(tgt_mount.c:153:server_get_mount()) get mount ffff907113d05800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787893166.406034:0:15847:0:(tgt_mount.c:187:server_put_mount()) put mount ffff907113d05800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787893166.406037:0:15847:0:(obd_mount.c:710:lustre_put_lsi()) put ffff907113d05800 3 00010000:00080000:2.0:1787893166.406065:0:15847:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9071086e5800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.129@tcp at head 00010000:00010000:2.0:1787893166.409106:0:15847:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1787893166.409408:0:15847:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1787893166.409443:0:15847:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787893166.409455:0:15847:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x825e3f5022b4b961 00000100:00080000:2.0:1787893166.409466:0:15847:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787893166.409478:0:15847:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9071086e5800 using connection 192.168.202.129@tcp/0@lo 00000100:00100000:2.0:1787893166.409511:0:15847:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90712e62ad80 x1874741455589504/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787893166.409534:0:15847:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787893166.409809:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e62ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1874741455589504:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787893166.409878:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893166.409932:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455589504 00000100:00100000:0.0:1787893166.409939:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455589504 00000100:00100000:0.0:1787893166.409969:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787893166.409976:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90700198e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1874741455589504:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787893166.409996:0:14437:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 494 last 0 00000020:00000080:0.0:1787893166.410032:0:14437:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x825e3f5022b4b968 00000004:00100000:0.0:1787893166.410047:0:14437:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787893166.410076:0:14437:0:(import.c:65:import_set_state_nolock()) ffff907124d04000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787893166.410121:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90700198e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874741455589504:12345-0@lo:38:llog_process_th.0 Request processed in 144us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893166.410129:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787893166.410162:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90712e62ad80 x1874741455589504/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787893176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893166.410174:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787893166.410194:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1787893166.410201:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787893166.410205:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787893166.410213:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9071086e5800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787893166.410230:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e62ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1874741455589504:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1787893166.412953:0:15847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:0.0:1787893166.419249:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455589632:0@lo:400:kworker.0 00000100:00100000:0.0:1787893166.419330:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787893166.419392:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787893166.419397:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787893166.419401:0:38:0:(import.c:65:import_set_state_nolock()) ffff907105a71800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787893166.419407:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 491 00000100:00080000:1.0:1787893166.419412:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787893166.419418:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff907105a71800 using connection 192.168.202.129@tcp/0@lo 00000100:00100000:1.0:1787893166.419450:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9070010ce300 x1874741455589760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787893166.419473:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874741455589760:0@lo:8:kworker.0 00000100:00100000:1.0:1787893166.419505:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893166.419580:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455589632 00000100:00100000:2.0:1787893166.419586:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455589632 00000100:00100000:2.0:1787893166.419634:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455589760 00000100:00100000:2.0:1787893166.419637:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455589760 00000100:00100000:2.0:1787893166.419650:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787893166.419659:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90700198fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1874741455589632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893166.419772:0:15121:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787893166.419782:0:15121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1787893166.421546:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874741455589888:0@lo:400:kworker.0 00000100:00100000:1.0:1787893166.421602:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893166.421668:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455589888 00000100:00100000:1.0:1787893166.421676:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455589888 00000100:00100000:1.0:1787893166.421723:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787893166.421732:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070010cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874741455589888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893166.421795:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070010cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874741455589888:12345-0@lo:400:kworker.0 Request processed in 63us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893166.421802:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1787893166.421841:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9070010cea00 x1874741455589888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893166.421855:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874741455589888:0@lo:400:kworker.0 00000100:00100000:1.0:1787893166.421900:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787893166.421907:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874741455590016:0@lo:400:kworker.0 00000100:00100000:1.0:1787893166.421930:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893166.421956:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455590016 00000100:00100000:1.0:1787893166.421959:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455590016 00000100:00100000:1.0:1787893166.421989:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787893166.421994:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070010ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874741455590016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893166.422025:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070010ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874741455590016:12345-0@lo:400:kworker.0 Request processed in 31us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893166.422031:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1787893166.422056:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9070010cea00 x1874741455590016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893166.422066:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1874741455590016:0@lo:400:kworker.0 00000020:01000000:1.0:1787893166.422092:0:15835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787893166.422123:0:15835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787893166.422137:0:15835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff907104f46e00/0x825e3f5022b4b94c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b953 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893166.422155:0:15835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff907104f46e00/0x825e3f5022b4b94c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b953 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787893166.422824:0:15835:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787893166.422826:0:15835:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787893166.422828:0:15835:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787893166.422829:0:15835:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787893166.422831:0:15835:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787893166.422832:0:15835:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787893166.422834:0:15835:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787893166.422836:0:15835:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787893166.422837:0:15835:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787893166.422841:0:15835:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1787893166.422844:0:15835:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787893166.422845:0:15835:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787893166.422847:0:15835:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787893166.422848:0:15835:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787893166.422849:0:15835:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787893166.422850:0:15835:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787893166.422851:0:15835:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787893166.422853:0:15835:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787893166.422854:0:15835:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787893166.422881:0:15835:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787893166.422892:0:15835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010cea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15835:1874741455590144:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787893166.422928:0:15835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893166.422958:0:15835:0:(client.c:2715:ptlrpc_set_wait()) set ffff90712f9e9240 going to sleep for 11 seconds 00000100:00100000:2.0:1787893166.423058:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90700198fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1874741455589632:12345-0@lo:400:kworker.0 Request processed in 3398us (3727us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893166.423068:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1787893166.423090:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787893166.423094:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787893166.423109:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787893166.423114:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070010cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3304:x1874741455589760:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787893166.423159:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070010cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3304:x1874741455589760:12345-0@lo:8:kworker.0 Request processed in 44us (3653us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787893166.423166:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787893166.423714:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455590144 00000100:00100000:3.0:1787893166.423721:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455590144 00000100:00100000:3.0:1787893166.423779:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787893166.423786:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137bc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+19:15835:x1874741455590144:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787893166.423810:0:14431:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787893166.423821:0:14431:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1787893166.424348:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787893166.424357:0:3304:0:(import.c:65:import_set_state_nolock()) ffff907105a71800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787893166.424362:0:3304:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787893166.424366:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874741455589760:0@lo:8:kworker.0 00000100:00100000:0.0:1787893166.424889:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455589632:0@lo:400:kworker.0 20000000:01000000:1.0:1787893166.453538:0:14431:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787893166.453557:0:14431:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787893166.454098:0:14453:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787893166.454103:0:14453:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787893166.454126:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907139b9fa00/0x825e3f5022b4b96f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893166.454147:0:14453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9071013fde00/0x825e3f5022b4b842 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4b83b expref: 19 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893166.454156:0:14453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907139b9fa00/0x825e3f5022b4b96f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893166.454211:0:14453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9071013fde00/0x825e3f5022b4b842 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x825e3f5022b4b83b expref: 19 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893166.454236:0:14453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9071013fde00/0x825e3f5022b4b842 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x825e3f5022b4b83b expref: 19 pid: 14430 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893166.454251:0:14453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e62b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14453:1874741455590272:0@lo:104: 00000100:00100000:2.0:1787893166.454315:0:14453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893166.454354:0:14453:0:(client.c:2715:ptlrpc_set_wait()) set ffff90713f4a6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787893166.454524:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455590272 00000100:00100000:0.0:1787893166.454532:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455590272 00000100:00100000:0.0:1787893166.454580:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787893166.454590:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e629f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f31ac154-369d-4473-bca1-5cb1596e1d9c+3:14453:x1874741455590272:12345-0@lo:104: 00010000:00010000:0.0:1787893166.454603:0:14420:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff9071013fce00/0x825e3f5022b4b83b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4b842 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893166.454653:0:14420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787893166.454659:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e629f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f31ac154-369d-4473-bca1-5cb1596e1d9c+3:14453:x1874741455590272:12345-0@lo:104: Request processed in 71us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893166.454667:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1787893166.454688:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787893166.454694:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff9071013fce00/0x825e3f5022b4b83b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4b842 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893166.454702:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071013fce00 already unused, calling callback (ffffffffc1c05c20) 10000000:00010000:0.0:1787893166.454706:0:14425:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff9071013fce00/0x825e3f5022b4b83b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x825e3f5022b4b842 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893166.454715:0:14425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff9071013fce00/0x825e3f5022b4b83b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x825e3f5022b4b842 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787893166.454735:0:14425:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff9071013fce00/0x825e3f5022b4b83b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x825e3f5022b4b842 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787893166.454742:0:14425:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787893166.454788:0:14425:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff9071013fce00/0x825e3f5022b4b83b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4b842 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893166.454796:0:14425:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787893166.454814:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff9071013fce00/0x825e3f5022b4b83b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4b842 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893166.454822:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff9071013fce00/0x825e3f5022b4b83b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4b842 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893166.454837:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893166.454840:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893166.454842:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893166.454855:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787893166.454866:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90700198c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f31ac154-369d-4473-bca1-5cb1596e1d9c:3305:1874741455590400:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787893166.454893:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893166.454927:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455590400 00000100:00100000:0.0:1787893166.454931:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455590400 00010000:00010000:0.0:1787893166.454947:0:14424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9071013fde00/0x825e3f5022b4b842 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4b83b expref: 20 pid: 14430 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893166.454969:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787893166.454975:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90700198f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f31ac154-369d-4473-bca1-5cb1596e1d9c+20:3305:x1874741455590400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787893166.454984:0:14424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893166.454995:0:14424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9071013fde00/0x825e3f5022b4b842 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4b83b expref: 20 pid: 14430 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893166.455005:0:14424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9071013fde00/0x825e3f5022b4b842 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x825e3f5022b4b83b expref: 20 pid: 14430 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893166.455020:0:14424:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff907139b9fa00/0x825e3f5022b4b96f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893166.455941:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907139b9fa00/0x825e3f5022b4b96f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787893166.455962:0:14424:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006406586s 00010000:00010000:0.0:1787893166.455967:0:14424:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907139b9fa00/0x825e3f5022b4b96f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893166.455975:0:14424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907139b9fa00/0x825e3f5022b4b96f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893166.455982:0:14424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907139b9fa00/0x825e3f5022b4b96f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893166.455989:0:14424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907139b9fa00/0x825e3f5022b4b96f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893166.455996:0:14424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9fa00 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:0.0:1787893166.456000:0:14424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907139b9fa00/0x825e3f5022b4b96f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893166.456008:0:14424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907139b9fa00/0x825e3f5022b4b96f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893166.456018:0:14424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907139b9fa00/0x825e3f5022b4b96f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893166.456391:0:14424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893166.456493:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90700198f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f31ac154-369d-4473-bca1-5cb1596e1d9c+20:3305:x1874741455590400:12345-0@lo:103:ldlm_bl.0 Request processed in 1515us (1595us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893166.456502:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1787893166.456552:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9071013fde00/0x825e3f5022b4b842 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x825e3f5022b4b83b expref: 19 pid: 14430 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893166.456565:0:14453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e62b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14453:1874741455590272:0@lo:104: 00010000:00010000:0.0:1787893166.456583:0:14453:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907139b9fa00/0x825e3f5022b4b96f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893166.456592:0:14453:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907139b9fa00/0x825e3f5022b4b96f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893166.456598:0:14453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907139b9fa00/0x825e3f5022b4b96f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893166.456605:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907139b9fa00/0x825e3f5022b4b96f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893166.457406:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90700198c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f31ac154-369d-4473-bca1-5cb1596e1d9c:3305:1874741455590400:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787893166.464033:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137bc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+18:15835:x1874741455590144:12345-0@lo:253:mount.lustre.0 Request processed in 40237us (41093us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893166.464047:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787893166.464138:0:15835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010cea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f31ac154-369d-4473-bca1-5cb1596e1d9c:15835:1874741455590144:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787893166.464153:0:15835:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787893166.464157:0:15835:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787893166.464158:0:15835:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787893166.464160:0:15835:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787893166.464161:0:15835:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787893166.464162:0:15835:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787893166.464164:0:15835:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787893166.464165:0:15835:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787893166.464167:0:15835:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787893166.464169:0:15835:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787893166.464182:0:15835:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787893166.477394:0:15835:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787893166.477559:0:15835:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787893166.477715:0:15835:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787893166.477885:0:15835:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787893166.478014:0:15835:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787893166.478239:0:15835:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787893166.479413:0:15835:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1787893166.534327:0:15835:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787893166.534338:0:15835:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787893166.534372:0:15835:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787893166.534430:0:15835:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.129@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787893166.534446:0:15835:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787893166.534474:0:15835:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000001:00080000:2.0:1787893166.878835:0:6725:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1787893166.878876:0:6725:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1787893167.370360:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893167.817860:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787893167.817884:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e628380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455590528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787893167.817955:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893167.818035:0:15122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455590528 00000100:00100000:2.0:1787893167.818044:0:15122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455590528 00000100:00100000:2.0:1787893167.818109:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787893167.818118:0:15122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e62aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455590528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787893167.818152:0:15122:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787893167.818204:0:15122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e62aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455590528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893167.818238:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787893167.818276:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1787893167.818296:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e628380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455590528:0@lo:13:osp-pre-0-0.0 10000000:01000000:2.0:1787893167.881501:0:14434:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787893167.881511:0:14434:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9071087e7000 from 8 10000000:01000000:2.0:1787893167.881517:0:14434:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787893167.881567:0:14434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff907139b9e800/0x825e3f5022b4b976 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893167.881580:0:14434:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff907139b9e800/0x825e3f5022b4b976 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893167.881593:0:14434:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff907139b9e800/0x825e3f5022b4b976 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893167.881622:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e628380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f31ac154-369d-4473-bca1-5cb1596e1d9c:14434:1874741455590656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787893167.881792:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893167.881844:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff90713f4a6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787893167.881984:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455590656 00000100:00100000:0.0:1787893167.881992:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455590656 00000100:00100000:0.0:1787893167.882034:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787893167.882042:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137bc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+18:14434:x1874741455590656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787893167.882055:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893167.882069:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907137fc8200/0x825e3f5022b4b97d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4b976 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893167.882110:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907137fc8200/0x825e3f5022b4b97d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4b976 expref: 19 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893167.882120:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907137fc8200/0x825e3f5022b4b97d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4b976 expref: 19 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893167.882129:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907137fc8200, rc 0) 00000100:00100000:0.0:1787893167.882179:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137bc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+19:14434:x1874741455590656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893167.882186:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787893167.882269:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e628380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f31ac154-369d-4473-bca1-5cb1596e1d9c:14434:1874741455590656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787893167.882285:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff907139b9e800/0x825e3f5022b4b976 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b97d expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893167.882294:0:14434:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff907139b9e800/0x825e3f5022b4b976 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4b97d expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893167.882344:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f31ac154-369d-4473-bca1-5cb1596e1d9c:14434:1874741455590784:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787893167.882381:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893167.882408:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff907110de9180 going to sleep for 11 seconds 00000100:00100000:2.0:1787893167.882456:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455590784 00000100:00100000:2.0:1787893167.882460:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455590784 00000100:00100000:2.0:1787893167.882491:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787893167.882497:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137bc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+19:14434:x1874741455590784:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787893167.882510:0:14430:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787893167.882526:0:14430:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787893167.882529:0:14430:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1787893167.882594:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137bc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+19:14434:x1874741455590784:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 97us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893167.882602:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787893167.882692:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010cea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f31ac154-369d-4473-bca1-5cb1596e1d9c:14434:1874741455590784:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787893167.882924:0:14434:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787893167.882931:0:14434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff907139b9e800/0x825e3f5022b4b976 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b97d expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893167.882939:0:14434:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff907139b9e800/0x825e3f5022b4b976 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4b97d expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893168.395530:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893169.416904:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893170.441137:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787893170.825863:0:14469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787893171.468786:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787893171.916298:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787893171.916306:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787893171.916374:0:36:0:(import.c:65:import_set_state_nolock()) ffff907105a71800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787893171.916388:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff907105a71800 using connection 192.168.202.129@tcp/0@lo 00000100:00100000:2.0:1787893171.916412:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90712e629c00 x1874741455591168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787893171.916501:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e62a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f31ac154-369d-4473-bca1-5cb1596e1d9c:3308:1874741455590912:0@lo:400:kworker.0 00000100:00100000:2.0:1787893171.916570:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893171.916613:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874741455591552:0@lo:400:kworker.0 00000100:00100000:2.0:1787893171.916644:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893171.916671:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787893171.916676:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874741455591424:0@lo:400:kworker.0 00000100:00100000:2.0:1787893171.916697:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893171.916724:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e62a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455591040:0@lo:400:kworker.0 00000100:00100000:2.0:1787893171.916749:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893171.916783:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787893171.916789:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e628a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874741455591296:0@lo:400:kworker.0 00000100:00100000:2.0:1787893171.916811:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893171.916837:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e629c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874741455591168:0@lo:8:kworker.0 00000100:00100000:2.0:1787893171.917004:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893171.917046:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455590912 00000100:00100000:2.0:1787893171.917054:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455590912 00000100:00100000:2.0:1787893171.917527:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787893171.917538:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f9e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+19:3308:x1874741455590912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893171.917588:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f9e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+19:3308:x1874741455590912:12345-0@lo:400:kworker.0 Request processed in 51us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893171.917606:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787893171.917639:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455591552 00000100:00100000:2.0:1787893171.917643:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455591552 00000100:00100000:2.0:1787893171.917675:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455591424 00000100:00100000:2.0:1787893171.917678:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455591424 00000100:00100000:2.0:1787893171.917692:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455591296 00000100:00100000:2.0:1787893171.917694:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455591296 00000100:00100000:2.0:1787893171.917707:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787893171.917713:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874741455591552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893171.917743:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874741455591552:12345-0@lo:400:kworker.0 Request processed in 31us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893171.917768:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787893171.917783:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787893171.917789:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e62b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874741455591424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893171.917817:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e62b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874741455591424:12345-0@lo:400:kworker.0 Request processed in 28us (1119us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893171.917823:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787893171.917835:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787893171.917840:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874741455591296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893171.917988:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455591040 00000100:00100000:1.0:1787893171.917993:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455591040 00000100:00100000:1.0:1787893171.918022:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455591168 00000100:00100000:1.0:1787893171.918024:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455591168 00000100:00100000:1.0:1787893171.918041:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787893171.918047:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e62ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455591040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787893171.918796:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e62ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455591040:12345-0@lo:400:kworker.0 Request processed in 747us (2043us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893171.918805:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787893171.918822:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787893171.918827:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e62b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1874741455591168:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787893171.918851:0:15119:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 499 last 0 00000020:00000080:1.0:1787893171.918893:0:15119:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x825e3f5022b4b984 00002000:00100000:1.0:1787893171.918908:0:15119:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff90713788b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113954 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1787893171.918912:0:15119:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1787893171.918920:0:15119:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787893171.919536:0:15119:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787893171.919562:0:15119:0:(import.c:65:import_set_state_nolock()) ffff90713788c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787893171.919616:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e62b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1874741455591168:12345-0@lo:8:kworker.0 Request processed in 787us (2611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893171.919623:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787893171.919679:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90712e629c00 x1874741455591168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787893196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787893171.919694:0:3304:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787893171.919701:0:3304:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787893171.919707:0:3304:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787893171.919709:0:3304:0:(import.c:65:import_set_state_nolock()) ffff907105a71800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787893171.919724:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787893171.919729:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e629c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1874741455591168:0@lo:8:kworker.0 00000004:00080000:1.0:1787893171.919799:0:14462:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:1.0:1787893171.919817:0:14462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010ce300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14462:1874741455591808:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787893171.919848:0:14462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893171.919934:0:14462:0:(client.c:2715:ptlrpc_set_wait()) set ffff907121322000 going to sleep for 11 seconds 00000100:00100000:1.0:1787893171.919947:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787893171.919955:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455591680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787893171.919979:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893171.920005:0:15122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455591680 00000100:00100000:1.0:1787893171.920010:0:15122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455591680 00000100:00100000:1.0:1787893171.920041:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787893171.920048:0:15122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070010ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1874741455591680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787893171.920069:0:15122:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787893171.920440:0:15122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070010ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1874741455591680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 392us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893171.920457:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787893171.920491:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9070010cea00 x1874741455591680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787893187 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787893171.920507:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455591680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787893171.920534:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e62a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455591040:0@lo:400:kworker.0 00000100:00100000:1.0:1787893171.920794:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455591808 00000100:00100000:1.0:1787893171.920799:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455591808 00000100:00100000:1.0:1787893171.920824:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787893171.920831:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070010cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14462:x1874741455591808:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787893171.922992:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874741455591296:12345-0@lo:400:kworker.0 Request processed in 5145us (6173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893171.923006:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1787893171.923086:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787893171.923212:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787893171.923216:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787893171.923393:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90712e628e00 x1874741455591424/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893171.923422:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e628e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1874741455591424:0@lo:400:kworker.0 00000100:00100000:2.0:1787893171.923437:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e62a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f31ac154-369d-4473-bca1-5cb1596e1d9c:3308:1874741455590912:0@lo:400:kworker.0 00010000:00080000:2.0:1787893171.923449:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90712e629880 x1874741455591552/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787893171.923457:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e629880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874741455591552:0@lo:400:kworker.0 00000004:00080000:3.0:1787893171.923613:0:14461:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787893171.925521:0:14461:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 499692765107ns, next at 0ns, rc = 0 00010000:00080000:0.0:1787893171.929570:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90712e628a80 x1874741455591296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787893187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787893171.929590:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e628a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874741455591296:0@lo:400:kworker.0 00002000:00080000:1.0:1787893171.938921:0:15119:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1787893171.938934:0:15119:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1787893171.938940:0:15119:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:1.0:1787893171.958072:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787893171.958085:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000662e02ea/0x825e3f5022b4b98b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.958790:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=499s v=(0 0) 00010000:00010000:1.0:1787893171.958795:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893171.958801:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000662e02ea/0x825e3f5022b4b98b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.958821:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000662e02ea/0x825e3f5022b4b98b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.958831:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000662e02ea/0x825e3f5022b4b98b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.958846:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000662e02ea/0x825e3f5022b4b98b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.958863:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787893171.959437:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787893171.959445:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000662e02ea/0x825e3f5022b4b98b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893171.959455:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153bc00 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:2.0:1787893171.959460:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000662e02ea/0x825e3f5022b4b98b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893171.959469:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000662e02ea/0x825e3f5022b4b98b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893171.959487:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000662e02ea/0x825e3f5022b4b98b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893171.959494:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000662e02ea/0x825e3f5022b4b98b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893171.959515:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893171.959517:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893171.959526:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787893171.961710:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787893171.961723:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003298ec6/0x825e3f5022b4b992 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.961740:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=499s v=(0 0) 00010000:00010000:1.0:1787893171.961746:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893171.961768:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003298ec6/0x825e3f5022b4b992 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.961783:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003298ec6/0x825e3f5022b4b992 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.961793:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003298ec6/0x825e3f5022b4b992 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.961802:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003298ec6/0x825e3f5022b4b992 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.961825:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787893171.961840:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893171.961846:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003298ec6/0x825e3f5022b4b992 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.961861:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153ac00 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:1.0:1787893171.961866:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003298ec6/0x825e3f5022b4b992 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.961876:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003298ec6/0x825e3f5022b4b992 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.961892:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003298ec6/0x825e3f5022b4b992 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.961900:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003298ec6/0x825e3f5022b4b992 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.961920:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893171.961922:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893171.961924:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787893171.965965:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787893171.965978:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd4a15ef/0x825e3f5022b4b999 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.965996:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=499s v=(0 0) 00010000:00010000:1.0:1787893171.966001:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893171.966008:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd4a15ef/0x825e3f5022b4b999 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.966023:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd4a15ef/0x825e3f5022b4b999 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.966040:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd4a15ef/0x825e3f5022b4b999 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.966048:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd4a15ef/0x825e3f5022b4b999 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.966073:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787893171.971096:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893171.971113:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd4a15ef/0x825e3f5022b4b999 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.971129:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153a000 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:1.0:1787893171.971144:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd4a15ef/0x825e3f5022b4b999 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.971155:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd4a15ef/0x825e3f5022b4b999 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.971208:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd4a15ef/0x825e3f5022b4b999 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.971218:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd4a15ef/0x825e3f5022b4b999 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.971419:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893171.971429:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893171.971431:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787893171.972035:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787893171.972043:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048f0289e/0x825e3f5022b4b9a0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.972057:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=499s v=(0 0) 00010000:00010000:1.0:1787893171.972061:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893171.972068:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048f0289e/0x825e3f5022b4b9a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.972079:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048f0289e/0x825e3f5022b4b9a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.972089:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048f0289e/0x825e3f5022b4b9a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.972096:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048f0289e/0x825e3f5022b4b9a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.972111:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787893171.972121:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893171.972125:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048f0289e/0x825e3f5022b4b9a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.972133:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153aa00 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:1.0:1787893171.972137:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048f0289e/0x825e3f5022b4b9a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.972157:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048f0289e/0x825e3f5022b4b9a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.972181:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048f0289e/0x825e3f5022b4b9a0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.972189:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048f0289e/0x825e3f5022b4b9a0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.972206:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893171.972208:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893171.972209:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787893171.978158:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787893171.978186:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003298ec6/0x825e3f5022b4b9a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.978204:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=499s v=(0 0) 00010000:00010000:1.0:1787893171.978209:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893171.978215:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003298ec6/0x825e3f5022b4b9a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.978234:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003298ec6/0x825e3f5022b4b9a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.978244:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003298ec6/0x825e3f5022b4b9a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.978258:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003298ec6/0x825e3f5022b4b9a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.978287:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787893171.978299:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893171.978305:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003298ec6/0x825e3f5022b4b9a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.982558:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153ac00 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:1.0:1787893171.982566:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003298ec6/0x825e3f5022b4b9a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.982579:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003298ec6/0x825e3f5022b4b9a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.982601:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003298ec6/0x825e3f5022b4b9a7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.982609:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003298ec6/0x825e3f5022b4b9a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.982631:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893171.982633:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893171.982636:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787893171.984036:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787893171.984055:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd4a15ef/0x825e3f5022b4b9ae lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.984069:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=499s v=(0 0) 00010000:00010000:1.0:1787893171.984074:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893171.984080:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd4a15ef/0x825e3f5022b4b9ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.990231:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd4a15ef/0x825e3f5022b4b9ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.990250:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd4a15ef/0x825e3f5022b4b9ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.990258:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd4a15ef/0x825e3f5022b4b9ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.990416:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787893171.991811:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787893171.991822:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048f0289e/0x825e3f5022b4b9b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.991836:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=499s v=(0 0) 00010000:00010000:1.0:1787893171.991840:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893171.991846:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048f0289e/0x825e3f5022b4b9b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.991857:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048f0289e/0x825e3f5022b4b9b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.991888:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048f0289e/0x825e3f5022b4b9b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.991895:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048f0289e/0x825e3f5022b4b9b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.991920:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787893171.992292:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787893171.992300:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd4a15ef/0x825e3f5022b4b9ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893171.992489:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787893171.993296:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153a000 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:0.0:1787893171.993305:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd4a15ef/0x825e3f5022b4b9ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893171.994430:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd4a15ef/0x825e3f5022b4b9ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893171.994463:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd4a15ef/0x825e3f5022b4b9ae lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893171.994481:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd4a15ef/0x825e3f5022b4b9ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893171.994512:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893171.994514:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893171.994516:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893171.996016:0:16140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893171.996028:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048f0289e/0x825e3f5022b4b9b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893171.996039:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153aa00 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:0.0:1787893171.996044:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048f0289e/0x825e3f5022b4b9b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893171.996054:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048f0289e/0x825e3f5022b4b9b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893171.996071:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048f0289e/0x825e3f5022b4b9b5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893171.996077:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048f0289e/0x825e3f5022b4b9b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893171.996109:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893171.996111:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893171.996113:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893171.996124:0:16140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893171.996126:0:16140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787893171.996726:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787893171.996735:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003298ec6/0x825e3f5022b4b9bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.996749:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=499s v=(0 0) 00010000:00010000:1.0:1787893171.996770:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893171.996777:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003298ec6/0x825e3f5022b4b9bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.996790:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003298ec6/0x825e3f5022b4b9bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.996798:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003298ec6/0x825e3f5022b4b9bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.996805:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003298ec6/0x825e3f5022b4b9bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893171.996836:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787893171.998297:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787893171.998307:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003298ec6/0x825e3f5022b4b9bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893171.998425:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153ac00 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:0.0:1787893171.998430:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003298ec6/0x825e3f5022b4b9bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893171.998441:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003298ec6/0x825e3f5022b4b9bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893171.998465:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003298ec6/0x825e3f5022b4b9bc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893171.998473:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003298ec6/0x825e3f5022b4b9bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893171.998499:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893171.998501:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893171.998503:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787893172.000691:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787893172.000706:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000662e02ea/0x825e3f5022b4b9c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.000723:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=499s v=(0 0) 00010000:00010000:1.0:1787893172.000728:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893172.000734:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000662e02ea/0x825e3f5022b4b9c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.000747:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000662e02ea/0x825e3f5022b4b9c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.000774:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000662e02ea/0x825e3f5022b4b9c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.000782:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000662e02ea/0x825e3f5022b4b9c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.000808:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787893172.000858:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787893172.000867:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000662e02ea/0x825e3f5022b4b9c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893172.000877:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153bc00 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:2.0:1787893172.000882:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000662e02ea/0x825e3f5022b4b9c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893172.000892:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000662e02ea/0x825e3f5022b4b9c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893172.000907:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000662e02ea/0x825e3f5022b4b9c3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893172.000914:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000662e02ea/0x825e3f5022b4b9c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893172.000997:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893172.001001:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893172.001002:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787893172.004602:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787893172.004616:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b152b258/0x825e3f5022b4b9ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.004633:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=499s v=(0 0) 00010000:00010000:1.0:1787893172.004645:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893172.004653:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b152b258/0x825e3f5022b4b9ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.004669:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b152b258/0x825e3f5022b4b9ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.004679:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b152b258/0x825e3f5022b4b9ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.004687:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b152b258/0x825e3f5022b4b9ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.004712:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787893172.006420:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787893172.006433:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004609cec3/0x825e3f5022b4b9d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.006449:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=499s v=(0 0) 00010000:00010000:1.0:1787893172.006454:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893172.006460:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004609cec3/0x825e3f5022b4b9d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.006474:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004609cec3/0x825e3f5022b4b9d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.006485:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004609cec3/0x825e3f5022b4b9d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.006500:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004609cec3/0x825e3f5022b4b9d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.006523:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787893172.006541:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787893172.006547:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b152b258/0x825e3f5022b4b9ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.006555:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90710153b000 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:1.0:1787893172.006560:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b152b258/0x825e3f5022b4b9ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.006571:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b152b258/0x825e3f5022b4b9ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.006589:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b152b258/0x825e3f5022b4b9ca lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.006597:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b152b258/0x825e3f5022b4b9ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.006617:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893172.006620:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004609cec3/0x825e3f5022b4b9d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.006639:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fa400 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:1.0:1787893172.006643:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004609cec3/0x825e3f5022b4b9d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.006651:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004609cec3/0x825e3f5022b4b9d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.006662:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004609cec3/0x825e3f5022b4b9d1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.006670:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004609cec3/0x825e3f5022b4b9d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.006685:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893172.006687:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893172.006689:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893172.006698:0:16140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787893172.009918:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787893172.009934:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061a2157f/0x825e3f5022b4b9d8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.009950:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=499s v=(0 0) 00010000:00010000:1.0:1787893172.009955:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893172.009961:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061a2157f/0x825e3f5022b4b9d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.009989:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061a2157f/0x825e3f5022b4b9d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.010000:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061a2157f/0x825e3f5022b4b9d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.010008:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000061a2157f/0x825e3f5022b4b9d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.010039:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787893172.010642:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787893172.010655:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000061a2157f/0x825e3f5022b4b9d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893172.010664:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fb600 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:2.0:1787893172.010670:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000061a2157f/0x825e3f5022b4b9d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893172.010687:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000061a2157f/0x825e3f5022b4b9d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893172.010704:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000061a2157f/0x825e3f5022b4b9d8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893172.010711:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061a2157f/0x825e3f5022b4b9d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893172.010732:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893172.010734:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893172.010736:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787893172.013299:0:5870:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:1.0:1787893172.013944:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787893172.013954:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f01a69c/0x825e3f5022b4b9df lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.013970:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=499s v=(0 0) 00010000:00010000:1.0:1787893172.013974:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893172.013981:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f01a69c/0x825e3f5022b4b9df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.013994:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f01a69c/0x825e3f5022b4b9df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.014006:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f01a69c/0x825e3f5022b4b9df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.014028:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f01a69c/0x825e3f5022b4b9df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.014048:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787893172.014060:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893172.014066:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f01a69c/0x825e3f5022b4b9df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.014075:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fa000 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:1.0:1787893172.014079:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f01a69c/0x825e3f5022b4b9df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.014089:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f01a69c/0x825e3f5022b4b9df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.014105:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f01a69c/0x825e3f5022b4b9df lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.014113:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f01a69c/0x825e3f5022b4b9df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.014132:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893172.014134:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893172.014136:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787893172.018507:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787893172.018529:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004609cec3/0x825e3f5022b4b9e6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.018547:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=499s v=(0 0) 00010000:00010000:1.0:1787893172.018552:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893172.018558:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004609cec3/0x825e3f5022b4b9e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.018574:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004609cec3/0x825e3f5022b4b9e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.018585:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004609cec3/0x825e3f5022b4b9e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.018593:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004609cec3/0x825e3f5022b4b9e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.018617:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787893172.019053:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787893172.019060:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2260026/0x825e3f5022b4b9ed lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.019070:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=499s v=(0 0) 00010000:00010000:1.0:1787893172.019073:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893172.019078:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2260026/0x825e3f5022b4b9ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.019089:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2260026/0x825e3f5022b4b9ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.019104:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2260026/0x825e3f5022b4b9ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.019113:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2260026/0x825e3f5022b4b9ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.019373:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787893172.019822:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787893172.019829:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000529c3890/0x825e3f5022b4b9f4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.019840:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=499s v=(0 0) 00010000:00010000:1.0:1787893172.019844:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893172.019848:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000529c3890/0x825e3f5022b4b9f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.019859:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000529c3890/0x825e3f5022b4b9f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.019867:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000529c3890/0x825e3f5022b4b9f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.019874:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000529c3890/0x825e3f5022b4b9f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893172.022365:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787893172.022381:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004609cec3/0x825e3f5022b4b9e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893172.022397:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fa400 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:3.0:1787893172.022402:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004609cec3/0x825e3f5022b4b9e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893172.022413:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004609cec3/0x825e3f5022b4b9e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893172.022440:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004609cec3/0x825e3f5022b4b9e6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893172.022460:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004609cec3/0x825e3f5022b4b9e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893172.022488:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787893172.022492:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2260026/0x825e3f5022b4b9ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893172.022498:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fb400 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:3.0:1787893172.022502:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2260026/0x825e3f5022b4b9ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893172.022509:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2260026/0x825e3f5022b4b9ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893172.022519:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2260026/0x825e3f5022b4b9ed lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893172.022526:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2260026/0x825e3f5022b4b9ed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893172.022541:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787893172.022544:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000529c3890/0x825e3f5022b4b9f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893172.022550:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fbe00 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:3.0:1787893172.022560:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000529c3890/0x825e3f5022b4b9f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893172.022568:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000529c3890/0x825e3f5022b4b9f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893172.022579:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000529c3890/0x825e3f5022b4b9f4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893172.022588:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893172.022590:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893172.022592:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893172.022722:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787893172.022730:0:15119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000529c3890/0x825e3f5022b4b9f4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.022783:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787893172.023615:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787893172.023624:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080926921/0x825e3f5022b4b9fb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.023637:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=499s v=(0 0) 00010000:00010000:1.0:1787893172.023641:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893172.023647:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080926921/0x825e3f5022b4b9fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.023657:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080926921/0x825e3f5022b4b9fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.023666:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080926921/0x825e3f5022b4b9fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.023674:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080926921/0x825e3f5022b4b9fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.023693:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787893172.024140:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787893172.024151:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e7f8466/0x825e3f5022b4ba02 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.024161:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=499s v=(0 0) 00010000:00010000:3.0:1787893172.024458:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787893172.024465:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080926921/0x825e3f5022b4b9fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893172.024473:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fa800 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:3.0:1787893172.024477:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080926921/0x825e3f5022b4b9fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893172.024486:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080926921/0x825e3f5022b4b9fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893172.024501:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080926921/0x825e3f5022b4b9fb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893172.024509:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080926921/0x825e3f5022b4b9fb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893172.024533:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893172.024535:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893172.024537:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893172.024630:0:16140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893172.025890:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893172.025900:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e7f8466/0x825e3f5022b4ba02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.025916:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e7f8466/0x825e3f5022b4ba02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.025926:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e7f8466/0x825e3f5022b4ba02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.025934:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e7f8466/0x825e3f5022b4ba02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.025959:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787893172.027904:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787893172.027915:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000793e1aa8/0x825e3f5022b4ba09 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.027929:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=499s v=(0 0) 00010000:00010000:1.0:1787893172.027933:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893172.027938:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000793e1aa8/0x825e3f5022b4ba09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.027950:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000793e1aa8/0x825e3f5022b4ba09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.027965:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000793e1aa8/0x825e3f5022b4ba09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.027972:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000793e1aa8/0x825e3f5022b4ba09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.027987:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787893172.028301:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787893172.028319:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e7f8466/0x825e3f5022b4ba02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893172.028329:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fb200 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:0.0:1787893172.028341:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e7f8466/0x825e3f5022b4ba02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893172.028351:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e7f8466/0x825e3f5022b4ba02 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893172.028367:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e7f8466/0x825e3f5022b4ba02 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893172.028374:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e7f8466/0x825e3f5022b4ba02 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893172.028396:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787893172.028399:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000793e1aa8/0x825e3f5022b4ba09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893172.028406:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fac00 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:0.0:1787893172.028408:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000793e1aa8/0x825e3f5022b4ba09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893172.028415:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000793e1aa8/0x825e3f5022b4ba09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893172.028424:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000793e1aa8/0x825e3f5022b4ba09 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893172.028431:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000793e1aa8/0x825e3f5022b4ba09 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893172.028452:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893172.028454:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893172.028456:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893172.028656:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787893172.030927:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787893172.030941:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e200fbc9/0x825e3f5022b4ba10 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.030957:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=499s v=(0 0) 00010000:00010000:1.0:1787893172.030962:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893172.030968:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e200fbc9/0x825e3f5022b4ba10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.030980:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e200fbc9/0x825e3f5022b4ba10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.030990:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e200fbc9/0x825e3f5022b4ba10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.030998:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e200fbc9/0x825e3f5022b4ba10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.031066:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787893172.031597:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787893172.031603:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffda83d7/0x825e3f5022b4ba17 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.031613:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=499s v=(0 0) 00010000:00010000:1.0:1787893172.031617:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893172.031621:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffda83d7/0x825e3f5022b4ba17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.031629:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ffda83d7/0x825e3f5022b4ba17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.031637:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffda83d7/0x825e3f5022b4ba17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.031645:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ffda83d7/0x825e3f5022b4ba17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893172.034122:0:16140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787893172.034293:0:16140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e200fbc9/0x825e3f5022b4ba10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893172.034363:0:16140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fa200 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:0.0:1787893172.034370:0:16140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e200fbc9/0x825e3f5022b4ba10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893172.034382:0:16140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e200fbc9/0x825e3f5022b4ba10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893172.034404:0:16140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e200fbc9/0x825e3f5022b4ba10 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893172.034411:0:16140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e200fbc9/0x825e3f5022b4ba10 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893172.034433:0:16140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787893172.034437:0:16140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ffda83d7/0x825e3f5022b4ba17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893172.034444:0:16140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fa600 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:0.0:1787893172.034457:0:16140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffda83d7/0x825e3f5022b4ba17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893172.034466:0:16140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffda83d7/0x825e3f5022b4ba17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893172.034477:0:16140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ffda83d7/0x825e3f5022b4ba17 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893172.034485:0:16140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893172.034487:0:16140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893172.034489:0:16140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893172.034558:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787893172.034566:0:15119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ffda83d7/0x825e3f5022b4ba17 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787893172.039697:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787893172.039715:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000529c3890/0x825e3f5022b4ba1e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.039741:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=499s v=(0 0) 00010000:00010000:1.0:1787893172.039746:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893172.039804:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000529c3890/0x825e3f5022b4ba1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.039821:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000529c3890/0x825e3f5022b4ba1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.039833:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000529c3890/0x825e3f5022b4ba1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.039841:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000529c3890/0x825e3f5022b4ba1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893172.040837:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787893172.040848:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000529c3890/0x825e3f5022b4ba1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893172.040857:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fbe00 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:0.0:1787893172.040862:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000529c3890/0x825e3f5022b4ba1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893172.040871:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000529c3890/0x825e3f5022b4ba1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893172.040891:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000529c3890/0x825e3f5022b4ba1e lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893172.040900:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893172.040909:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893172.040911:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893172.041540:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787893172.041548:0:15119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000529c3890/0x825e3f5022b4ba1e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787893172.042191:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787893172.042208:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f01a69c/0x825e3f5022b4ba25 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.042220:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=499s v=(0 0) 00010000:00010000:1.0:1787893172.042225:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893172.042230:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f01a69c/0x825e3f5022b4ba25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.042257:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f01a69c/0x825e3f5022b4ba25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.042267:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f01a69c/0x825e3f5022b4ba25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.042275:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f01a69c/0x825e3f5022b4ba25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893172.047442:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787893172.047459:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f01a69c/0x825e3f5022b4ba25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893172.047474:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fa000 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:3.0:1787893172.047480:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f01a69c/0x825e3f5022b4ba25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893172.047491:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f01a69c/0x825e3f5022b4ba25 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893172.047512:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f01a69c/0x825e3f5022b4ba25 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893172.047522:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893172.047524:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787893172.047526:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893172.048843:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787893172.048857:0:15119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f01a69c/0x825e3f5022b4ba25 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787893172.049746:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787893172.049775:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000847664c2/0x825e3f5022b4ba2c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.049789:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=499s v=(0 0) 00010000:00010000:1.0:1787893172.049794:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893172.049799:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000847664c2/0x825e3f5022b4ba2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.049812:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000847664c2/0x825e3f5022b4ba2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.049834:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000847664c2/0x825e3f5022b4ba2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.049842:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000847664c2/0x825e3f5022b4ba2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.049862:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787893172.049877:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893172.049882:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000847664c2/0x825e3f5022b4ba2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.049890:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fae00 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:1.0:1787893172.049895:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000847664c2/0x825e3f5022b4ba2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.049904:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000847664c2/0x825e3f5022b4ba2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.049920:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000847664c2/0x825e3f5022b4ba2c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.049927:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000847664c2/0x825e3f5022b4ba2c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.049942:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893172.049948:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893172.049951:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893172.050295:0:16140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787893172.050565:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787893172.050571:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001978f1b4/0x825e3f5022b4ba33 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.050580:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=499s v=(0 0) 00010000:00010000:1.0:1787893172.050583:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893172.050587:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001978f1b4/0x825e3f5022b4ba33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.050596:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001978f1b4/0x825e3f5022b4ba33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.050603:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001978f1b4/0x825e3f5022b4ba33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.050610:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001978f1b4/0x825e3f5022b4ba33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.050633:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787893172.051033:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787893172.051039:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080926921/0x825e3f5022b4ba3a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.051045:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=499s v=(0 0) 00010000:00010000:1.0:1787893172.051048:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893172.051052:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080926921/0x825e3f5022b4ba3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.051068:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080926921/0x825e3f5022b4ba3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.051076:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080926921/0x825e3f5022b4ba3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.051084:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080926921/0x825e3f5022b4ba3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.051098:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787893172.051106:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787893172.051110:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001978f1b4/0x825e3f5022b4ba33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.051118:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421faa00 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:1.0:1787893172.051122:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001978f1b4/0x825e3f5022b4ba33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.051142:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001978f1b4/0x825e3f5022b4ba33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.051157:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001978f1b4/0x825e3f5022b4ba33 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.051166:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001978f1b4/0x825e3f5022b4ba33 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893172.051502:0:14425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787893172.051508:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080926921/0x825e3f5022b4ba3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893172.051515:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fa800 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:2.0:1787893172.051519:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080926921/0x825e3f5022b4ba3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893172.051527:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080926921/0x825e3f5022b4ba3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893172.051539:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080926921/0x825e3f5022b4ba3a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893172.051559:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080926921/0x825e3f5022b4ba3a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893172.051576:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893172.051578:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893172.051580:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893172.051616:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893172.051617:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893172.051619:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787893172.052160:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787893172.052178:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffda83d7/0x825e3f5022b4ba41 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.052187:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=499s v=(0 0) 00010000:00010000:1.0:1787893172.052191:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787893172.052301:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffda83d7/0x825e3f5022b4ba41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.052378:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ffda83d7/0x825e3f5022b4ba41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.052387:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffda83d7/0x825e3f5022b4ba41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.052396:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ffda83d7/0x825e3f5022b4ba41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893172.052413:0:15119:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1787893172.052602:0:15119:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:1.0:1787893172.052768:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070010cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14462:x1874741455591808:12345-0@lo:5:osp-pre-1-0.0 Request processed in 131915us (132897us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893172.052778:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1787893172.056045:0:16140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787893172.056062:0:16140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ffda83d7/0x825e3f5022b4ba41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893172.056077:0:16140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fa600 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:2.0:1787893172.056083:0:16140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffda83d7/0x825e3f5022b4ba41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893172.056094:0:16140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffda83d7/0x825e3f5022b4ba41 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893172.056118:0:16140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ffda83d7/0x825e3f5022b4ba41 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893172.056126:0:16140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ffda83d7/0x825e3f5022b4ba41 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893172.056422:0:16140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893172.056424:0:16140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893172.056426:0:16140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893172.056550:0:14462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010ce300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14462:1874741455591808:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787893172.056568:0:14462:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:1.0:1787893172.059480:0:14462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010cea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14462:1874741455591936:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787893172.059556:0:14462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893172.059670:0:14462:0:(client.c:2715:ptlrpc_set_wait()) set ffff90711b970a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787893172.061929:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455591936 00000100:00100000:3.0:1787893172.061944:0:15120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455591936 00000100:00100000:3.0:1787893172.064320:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787893172.064342:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070010ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14462:x1874741455591936:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1787893172.064396:0:15120:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1787893172.073422:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070010ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14462:x1874741455591936:12345-0@lo:5:osp-pre-1-0.0 Request processed in 9080us (13857us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787893172.073495:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787893172.073564:0:14462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010cea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14462:1874741455591936:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787893172.073582:0:14462:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:1.0:1787893172.488896:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787893172.517146:0:16194:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg229-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1787893172.937192:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787893172.937213:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455592064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787893172.937275:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893172.937323:0:15122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455592064 00000100:00100000:1.0:1787893172.937330:0:15122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455592064 00000100:00100000:1.0:1787893172.937427:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787893172.937437:0:15124:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1787893172.937438:0:15122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90700198f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455592064:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787893172.937445:0:15124:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:1.0:1787893172.937678:0:15122:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787893172.937738:0:15122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90700198f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455592064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 302us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893172.937745:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787893172.937860:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455592064:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787893173.513069:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787893174.536974:0:16140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893174.543921:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893174.545556:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431477888 00000100:00100000:1.0:1787893174.545585:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431477888 00000100:00100000:1.0:1787893174.545642:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 77 00000100:00100000:1.0:1787893174.545651:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f9e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2359:x1874741431477888:12345-192.168.202.29@tcp:250:mount.lustre.0 00010000:00080000:1.0:1787893174.545685:0:14432:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 5fa852aa-37e5-47a0-814e-47dc5f78a37a@192.168.202.29@tcp t0 exp 0000000000000000 cur 502 last 0 00000020:00000080:1.0:1787893174.545717:0:14432:0:(genops.c:1385:class_connect()) connect: client 5fa852aa-37e5-47a0-814e-47dc5f78a37a, cookie 0x825e3f5022b4ba48 00000100:00080000:1.0:1787893174.546100:0:14432:0:(import.c:65:import_set_state_nolock()) ffff90713788e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787893174.546183:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f9e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fa852aa-37e5-47a0-814e-47dc5f78a37a+5:2359:x1874741431477888:12345-192.168.202.29@tcp:250:mount.lustre.0 Request processed in 530us (2272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893174.546191:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 77 00000100:00100000:2.0:1787893174.549540:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893174.550993:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431478016 00000100:00100000:0.0:1787893174.551006:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431478016 00000100:00100000:0.0:1787893174.551072:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 78 00000100:00100000:0.0:1787893174.551082:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f9e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fa852aa-37e5-47a0-814e-47dc5f78a37a+5:13762:x1874741431478016:12345-192.168.202.29@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787893174.551100:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893174.551117:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907137fc8e00/0x825e3f5022b4ba4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b282 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893174.551157:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907137fc8e00/0x825e3f5022b4ba4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b282 expref: 6 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893174.551168:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907137fc8e00/0x825e3f5022b4ba4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b282 expref: 6 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893174.551177:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907137fc8e00, rc 0) 00000100:00100000:0.0:1787893174.551234:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f9e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fa852aa-37e5-47a0-814e-47dc5f78a37a+6:13762:x1874741431478016:12345-192.168.202.29@tcp:101:mount.lustre.0 Request processed in 153us (1704us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893174.551258:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 78 00000100:00100000:2.0:1787893174.556915:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893174.557445:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431478144 00000100:00100000:1.0:1787893174.557457:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431478144 00000100:00100000:1.0:1787893174.566882:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 79 00000100:00100000:1.0:1787893174.566912:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f9e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fa852aa-37e5-47a0-814e-47dc5f78a37a+6:13762:x1874741431478144:12345-192.168.202.29@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787893174.569261:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f9e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fa852aa-37e5-47a0-814e-47dc5f78a37a+6:13762:x1874741431478144:12345-192.168.202.29@tcp:501:mount.lustre.0 Request processed in 2353us (12347us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787893174.569276:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 79 00000100:00100000:3.0:1787893174.572420:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893174.572514:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431478272 00000100:00100000:2.0:1787893174.572524:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431478272 00000100:00100000:2.0:1787893174.572572:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 80 00000100:00100000:2.0:1787893174.572581:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f9e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fa852aa-37e5-47a0-814e-47dc5f78a37a+6:13762:x1874741431478272:12345-192.168.202.29@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787893174.572596:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893174.572613:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907139b9e200/0x825e3f5022b4ba56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b289 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893174.572642:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907139b9e200/0x825e3f5022b4ba56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b289 expref: 7 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893174.572653:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907139b9e200/0x825e3f5022b4ba56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b289 expref: 7 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893174.572662:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9e200, rc 0) 00000100:00100000:2.0:1787893174.572709:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f9e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fa852aa-37e5-47a0-814e-47dc5f78a37a+7:13762:x1874741431478272:12345-192.168.202.29@tcp:101:mount.lustre.0 Request processed in 129us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893174.572716:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 80 00000100:00100000:2.0:1787893174.577519:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893174.577612:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431478400 00000100:00100000:0.0:1787893174.577622:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431478400 00000100:00100000:0.0:1787893174.577672:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 81 00000100:00100000:0.0:1787893174.577682:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f9e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fa852aa-37e5-47a0-814e-47dc5f78a37a+7:13762:x1874741431478400:12345-192.168.202.29@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787893174.578020:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f9e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fa852aa-37e5-47a0-814e-47dc5f78a37a+8:13762:x1874741431478400:12345-192.168.202.29@tcp:501:mount.lustre.0 Request processed in 339us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893174.578026:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 81 00000100:00100000:2.0:1787893174.597123:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893174.597258:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431478528 00000100:00100000:1.0:1787893174.597268:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431478528 00000100:00100000:1.0:1787893174.597329:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 82 00000100:00100000:1.0:1787893174.597340:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f9ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fa852aa-37e5-47a0-814e-47dc5f78a37a+8:13762:x1874741431478528:12345-192.168.202.29@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787893174.598520:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f9ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fa852aa-37e5-47a0-814e-47dc5f78a37a+8:13762:x1874741431478528:12345-192.168.202.29@tcp:503:mount.lustre.0 Request processed in 1176us (1402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893174.598531:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 82 00000100:00100000:3.0:1787893174.608875:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893174.609027:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431478656 00000100:00100000:2.0:1787893174.609038:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431478656 00000100:00100000:2.0:1787893174.609095:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 83 00000100:00100000:2.0:1787893174.609106:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f9eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fa852aa-37e5-47a0-814e-47dc5f78a37a+8:13781:x1874741431478656:12345-192.168.202.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787893174.609525:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f9eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fa852aa-37e5-47a0-814e-47dc5f78a37a+8:13781:x1874741431478656:12345-192.168.202.29@tcp:502:llog_process_th.0 Request processed in 420us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893174.609533:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 83 00000100:00100000:0.0:1787893174.635998:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893174.636186:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431478784 00000100:00100000:2.0:1787893174.636205:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431478784 00000100:00100000:2.0:1787893174.636350:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 84 00000100:00100000:2.0:1787893174.636361:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f9e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fa852aa-37e5-47a0-814e-47dc5f78a37a+8:13781:x1874741431478784:12345-192.168.202.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787893174.636622:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f9e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fa852aa-37e5-47a0-814e-47dc5f78a37a+8:13781:x1874741431478784:12345-192.168.202.29@tcp:502:llog_process_th.0 Request processed in 260us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893174.636630:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 84 00000100:00100000:3.0:1787893174.649384:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893174.649544:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431478912 00000100:00100000:0.0:1787893174.649556:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431478912 00000100:00100000:0.0:1787893174.649637:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 85 00000100:00100000:0.0:1787893174.649647:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f9eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fa852aa-37e5-47a0-814e-47dc5f78a37a+8:13762:x1874741431478912:12345-192.168.202.29@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787893174.649670:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893174.649689:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907137fc9200/0x825e3f5022b4ba5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b2b3 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893174.649718:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907137fc9200/0x825e3f5022b4ba5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b2b3 expref: 9 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893174.649730:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907137fc9200/0x825e3f5022b4ba5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b2b3 expref: 9 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893174.649740:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907137fc9200, rc 0) 00000100:00100000:0.0:1787893174.649832:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f9eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fa852aa-37e5-47a0-814e-47dc5f78a37a+9:13762:x1874741431478912:12345-192.168.202.29@tcp:101:mount.lustre.0 Request processed in 186us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893174.649856:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 85 00000100:00100000:3.0:1787893174.654447:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893174.654637:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431479040 00000100:00100000:2.0:1787893174.654646:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431479040 00000100:00100000:2.0:1787893174.654700:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 86 00000100:00100000:2.0:1787893174.654712:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f9ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fa852aa-37e5-47a0-814e-47dc5f78a37a+9:13762:x1874741431479040:12345-192.168.202.29@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787893174.654738:0:14432:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787893174.654796:0:14432:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787893174.654801:0:14432:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787893174.654804:0:14432:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787893174.654806:0:14432:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1787893174.656596:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f9ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fa852aa-37e5-47a0-814e-47dc5f78a37a+9:13762:x1874741431479040:12345-192.168.202.29@tcp:256:mount.lustre.0 Request processed in 1876us (2150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893174.656609:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 86 00000100:00100000:3.0:1787893174.660962:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893174.661081:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431479168 00000100:00100000:2.0:1787893174.661092:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431479168 00000100:00100000:2.0:1787893174.661159:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 87 00000100:00100000:2.0:1787893174.661169:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f9eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fa852aa-37e5-47a0-814e-47dc5f78a37a+9:13762:x1874741431479168:12345-192.168.202.29@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787893174.661186:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893174.661346:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907139b9fa00/0x825e3f5022b4ba64 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b2ba expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893174.661381:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907139b9fa00/0x825e3f5022b4ba64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b2ba expref: 10 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893174.661394:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907139b9fa00/0x825e3f5022b4ba64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b2ba expref: 10 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893174.661404:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9fa00, rc 0) 00000100:00100000:2.0:1787893174.661523:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f9eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fa852aa-37e5-47a0-814e-47dc5f78a37a+10:13762:x1874741431479168:12345-192.168.202.29@tcp:101:mount.lustre.0 Request processed in 354us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893174.661531:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 87 00000100:00100000:3.0:1787893174.674444:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893174.677651:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431479296 00000100:00100000:0.0:1787893174.677670:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431479296 00000100:00100000:0.0:1787893174.677820:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 88 00000100:00100000:0.0:1787893174.677832:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f9ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fa852aa-37e5-47a0-814e-47dc5f78a37a+10:13762:x1874741431479296:12345-192.168.202.29@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787893174.678137:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f9ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fa852aa-37e5-47a0-814e-47dc5f78a37a+10:13762:x1874741431479296:12345-192.168.202.29@tcp:501:mount.lustre.0 Request processed in 306us (3704us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893174.678153:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 88 00000100:00100000:1.0:1787893174.690338:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893174.690475:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431479424 00000100:00100000:2.0:1787893174.690485:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431479424 00000100:00100000:2.0:1787893174.690541:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 89 00000100:00100000:2.0:1787893174.690551:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f9ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fa852aa-37e5-47a0-814e-47dc5f78a37a+10:13762:x1874741431479424:12345-192.168.202.29@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787893174.691225:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f9ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fa852aa-37e5-47a0-814e-47dc5f78a37a+10:13762:x1874741431479424:12345-192.168.202.29@tcp:503:mount.lustre.0 Request processed in 671us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893174.691235:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 89 00000100:00100000:3.0:1787893174.702443:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893174.705811:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431479552 00000100:00100000:2.0:1787893174.705830:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431479552 00000100:00100000:2.0:1787893174.705901:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 90 00000100:00100000:2.0:1787893174.705928:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f9eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fa852aa-37e5-47a0-814e-47dc5f78a37a+10:13786:x1874741431479552:12345-192.168.202.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787893174.706553:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f9eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fa852aa-37e5-47a0-814e-47dc5f78a37a+10:13786:x1874741431479552:12345-192.168.202.29@tcp:502:llog_process_th.0 Request processed in 627us (4117us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893174.706562:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 90 00000100:00100000:1.0:1787893174.723092:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893174.729879:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431479680 00000100:00100000:0.0:1787893174.729896:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431479680 00000100:00100000:3.0:1787893174.741574:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 91 00000100:00100000:3.0:1787893174.741588:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071075b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fa852aa-37e5-47a0-814e-47dc5f78a37a+10:13786:x1874741431479680:12345-192.168.202.29@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787893174.742019:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071075b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fa852aa-37e5-47a0-814e-47dc5f78a37a+10:13786:x1874741431479680:12345-192.168.202.29@tcp:502:llog_process_th.0 Request processed in 431us (18935us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893174.742027:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 91 00000100:00100000:1.0:1787893174.748895:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893174.749004:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431479808 00000100:00100000:2.0:1787893174.749015:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431479808 00000100:00100000:2.0:1787893174.749067:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 4 00000100:00100000:2.0:1787893174.749075:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070010cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2359:x1874741431479808:12345-192.168.202.29@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787893174.749104:0:14439:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 0bf598c2-503d-4eab-8bcc-148652504c30@192.168.202.29@tcp t0 exp 0000000000000000 cur 502 last 0 00000020:00000080:2.0:1787893174.749165:0:14439:0:(genops.c:1385:class_connect()) connect: client 0bf598c2-503d-4eab-8bcc-148652504c30, cookie 0x825e3f5022b4ba6b 00000004:00100000:2.0:1787893174.749206:0:14439:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1787893174.749212:0:14439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1787893174.866030:0:14439:0:(import.c:65:import_set_state_nolock()) ffff90712ebd3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787893174.866273:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070010cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bf598c2-503d-4eab-8bcc-148652504c30+6:2359:x1874741431479808:12345-192.168.202.29@tcp:38:mount.lustre.0 Request processed in 117195us (117389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893174.866351:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 4 00000100:00100000:2.0:1787893174.869530:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893174.869625:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893174.869954:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431480064 00000100:00100000:1.0:1787893174.869965:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431480064 00000100:00100000:1.0:1787893174.870079:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431479936 00000100:00100000:1.0:1787893174.870083:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431479936 00000100:00100000:1.0:1787893174.870122:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 5 00000100:00100000:1.0:1787893174.870133:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bf598c2-503d-4eab-8bcc-148652504c30+7:13762:x1874741431480064:12345-192.168.202.29@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787893174.870255:0:14437:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787893174.870348:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bf598c2-503d-4eab-8bcc-148652504c30+7:13762:x1874741431480064:12345-192.168.202.29@tcp:41:mount.lustre.0 Request processed in 216us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893174.870356:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 5 00000100:00100000:1.0:1787893174.870376:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 6 00000100:00100000:1.0:1787893174.870383:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e62a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bf598c2-503d-4eab-8bcc-148652504c30+6:0:x1874741431479936:12345-192.168.202.29@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787893174.870394:0:14437:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787893174.870416:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e62a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bf598c2-503d-4eab-8bcc-148652504c30+6:0:x1874741431479936:12345-192.168.202.29@tcp:41:mount.lustre.0 Request processed in 34us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893174.870441:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 6 00000100:00080000:2.0:1787893174.873064:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787893174.875100:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893174.875212:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431480192 00000100:00100000:2.0:1787893174.875221:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431480192 00000100:00100000:2.0:1787893174.875279:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 7 00000100:00100000:2.0:1787893174.875290:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070010cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bf598c2-503d-4eab-8bcc-148652504c30+6:13762:x1874741431480192:12345-192.168.202.29@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787893174.875385:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070010cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bf598c2-503d-4eab-8bcc-148652504c30+6:13762:x1874741431480192:12345-192.168.202.29@tcp:40:mount.lustre.0 Request processed in 96us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893174.875411:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 7 00000100:00100000:1.0:1787893174.879030:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893174.879073:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893174.879109:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893174.879218:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431480576 00000100:00100000:3.0:1787893174.879227:0:14440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431480576 00000100:00100000:3.0:1787893174.879268:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 0 00000100:00100000:3.0:1787893174.879276:0:14440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070010cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0bf598c2-503d-4eab-8bcc-148652504c30+6:13762:x1874741431480576:12345-192.168.202.29@tcp:33:mount.lustre.0 00000004:00080000:3.0:1787893174.879843:0:14440:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 501us 00000100:00100000:2.0:1787893174.882444:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431480320 00000100:00100000:2.0:1787893174.882457:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431480320 00000100:00100000:2.0:1787893174.882498:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431480448 00000100:00100000:2.0:1787893174.882500:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431480448 00000100:00100000:2.0:1787893174.882521:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 8 00000100:00100000:2.0:1787893174.882527:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070010cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2359:x1874741431480320:12345-192.168.202.29@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787893174.882553:0:15119:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 0bf598c2-503d-4eab-8bcc-148652504c30@192.168.202.29@tcp t0 exp 0000000000000000 cur 502 last 0 00000020:00000080:2.0:1787893174.882576:0:15119:0:(genops.c:1385:class_connect()) connect: client 0bf598c2-503d-4eab-8bcc-148652504c30, cookie 0x825e3f5022b4ba72 00002000:00100000:2.0:1787893174.882585:0:15119:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0bf598c2-503d-4eab-8bcc-148652504c30/ffff90712ebd4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787893174.882604:0:15119:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787893174.882894:0:15119:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787893174.882925:0:15119:0:(import.c:65:import_set_state_nolock()) ffff90712ebd4800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787893174.882994:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070010cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0bf598c2-503d-4eab-8bcc-148652504c30+6:2359:x1874741431480320:12345-192.168.202.29@tcp:8:mount.lustre.0 Request processed in 464us (3973us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893174.883002:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 8 00000100:00100000:2.0:1787893174.883020:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 9 00000100:00100000:2.0:1787893174.883025:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070010cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2359:x1874741431480448:12345-192.168.202.29@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787893174.883040:0:15119:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 0bf598c2-503d-4eab-8bcc-148652504c30@192.168.202.29@tcp t0 exp 0000000000000000 cur 502 last 0 00000020:00000080:2.0:1787893174.883056:0:15119:0:(genops.c:1385:class_connect()) connect: client 0bf598c2-503d-4eab-8bcc-148652504c30, cookie 0x825e3f5022b4ba79 00002000:00100000:2.0:1787893174.883060:0:15119:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0bf598c2-503d-4eab-8bcc-148652504c30/ffff90712ebd7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787893174.883073:0:15119:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787893174.883241:0:15119:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787893174.883253:0:15119:0:(import.c:65:import_set_state_nolock()) ffff90712ebd2800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787893174.883281:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070010cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0bf598c2-503d-4eab-8bcc-148652504c30+6:2359:x1874741431480448:12345-192.168.202.29@tcp:8:mount.lustre.0 Request processed in 254us (4171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893174.883288:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 9 00000004:00200000:3.0:1787893174.897626:0:14440:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1787893174.899321:0:14440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070010cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0bf598c2-503d-4eab-8bcc-148652504c30+6:13762:x1874741431480576:12345-192.168.202.29@tcp:33:mount.lustre.0 Request processed in 20034us (20236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893174.899346:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 0 00000100:00100000:1.0:1787893175.119388:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893175.121440:0:15611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431480704 00000100:00100000:0.0:1787893175.121454:0:15611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431480704 00000100:00100000:0.0:1787893175.121528:0:15611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 8 00000100:00100000:0.0:1787893175.121539:0:15611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f565880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0bf598c2-503d-4eab-8bcc-148652504c30+6:13807:x1874741431480704:12345-192.168.202.29@tcp:101:mkdir.0 00010000:00010000:0.0:1787893175.121559:0:15611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893175.121585:0:15611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9400/0x825e3f5022b4ba80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b2e4 expref: -99 pid: 15611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893175.121816:0:15611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4ba87 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893175.121831:0:15611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4ba87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893175.121845:0:15611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4ba87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893175.122055:0:15611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787893175.122065:0:15611:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787893175.122379:0:15611:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4ba87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893175.122410:0:15611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9400/0x825e3f5022b4ba80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b2e4 expref: 8 pid: 15611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893175.122427:0:15611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4ba87 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b2e4 expref: 7 pid: 15611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893175.122437:0:15611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9071061f7700) 00010000:00010000:0.0:1787893175.122440:0:15611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787893175.122444:0:15611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907137fc9e00, rc 0) 00000100:00100000:0.0:1787893175.122517:0:15611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f565880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0bf598c2-503d-4eab-8bcc-148652504c30+7:13807:x1874741431480704:12345-192.168.202.29@tcp:101:mkdir.0 Request processed in 978us (3139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893175.122525:0:15611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 8 00010000:00010000:2.0:1787893175.567309:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893176.589505:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893177.033299:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455592192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787893177.033384:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893177.033576:0:15124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455592192 00000100:00100000:1.0:1787893177.033587:0:15124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455592192 00000100:00100000:1.0:1787893177.033653:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787893177.033664:0:15124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1874741455592192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787893177.033702:0:15124:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1787893177.033994:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787893177.034135:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455592448:0@lo:400:kworker.0 00000100:00100000:3.0:1787893177.034173:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893177.034198:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787893177.034204:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874741455592576:0@lo:400:kworker.0 00000100:00100000:3.0:1787893177.034229:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893177.034290:0:15124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e628e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1874741455592192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893177.034299:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787893177.034391:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f31ac154-369d-4473-bca1-5cb1596e1d9c:3308:1874741455592320:0@lo:400:kworker.0 00000100:00100000:0.0:1787893177.034427:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893177.034450:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874741455592832:0@lo:400:kworker.0 00000100:00100000:0.0:1787893177.034471:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893177.040977:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874741455592704:0@lo:400:kworker.0 00000100:00100000:2.0:1787893177.041079:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455592320 00000100:00100000:2.0:1787893177.041087:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455592320 00000100:00100000:2.0:1787893177.041152:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787893177.041161:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071075b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+19:3308:x1874741455592320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893177.041221:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071075b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+19:3308:x1874741455592320:12345-0@lo:400:kworker.0 Request processed in 60us (6792us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893177.041228:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787893177.041372:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455592448 00000100:00100000:3.0:1787893177.041378:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455592448 00000100:00100000:3.0:1787893177.041421:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787893177.041429:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455592448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893177.041472:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455592448:12345-0@lo:400:kworker.0 Request processed in 45us (7299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893177.041478:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787893177.041523:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455592448:0@lo:400:kworker.0 00000100:00080000:3.0:1787893177.041546:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787893177.051319:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f31ac154-369d-4473-bca1-5cb1596e1d9c:3308:1874741455592320:0@lo:400:kworker.0 00000100:00100000:0.0:1787893177.052041:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893177.056393:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455592192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787893177.057766:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455592576 00000100:00100000:2.0:1787893177.058222:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455592576 00000100:00100000:2.0:1787893177.058364:0:15611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455592832 00000100:00100000:2.0:1787893177.058368:0:15611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455592832 00000100:00100000:2.0:1787893177.058393:0:15611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455592704 00000100:00100000:2.0:1787893177.058396:0:15611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455592704 00000100:00100000:2.0:1787893177.058416:0:15611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787893177.058425:0:15611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874741455592576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893177.058513:0:15611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874741455592576:12345-0@lo:400:kworker.0 Request processed in 88us (24282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893177.058519:0:15611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787893177.058535:0:15611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787893177.058549:0:15611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90700198ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874741455592832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893177.058583:0:15611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90700198ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874741455592832:12345-0@lo:400:kworker.0 Request processed in 35us (24111us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893177.058589:0:15611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787893177.058788:0:15611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787893177.058799:0:15611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90700198d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874741455592704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787893177.058835:0:15611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90700198d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874741455592704:12345-0@lo:400:kworker.0 Request processed in 39us (6797us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893177.059569:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874741455592704:0@lo:400:kworker.0 00000100:00100000:0.0:1787893177.059609:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1874741455592832:0@lo:400:kworker.0 00000100:00100000:0.0:1787893177.059635:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874741455592576:0@lo:400:kworker.0 00000100:00080000:0.0:1787893177.059660:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787893177.065983:0:15611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000001:00100000:3.0:1787893177.123250:0:6725:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0bf598c2-503d-4eab-8bcc-148652504c30 00000001:00100000:3.0:1787893177.141713:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787893177.141731:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0bf598c2-503d-4eab-8bcc-148652504c30 00000001:00080000:3.0:1787893177.141742:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000100:00100000:1.0:1787893177.310455:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893177.310552:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431480832 00000100:00100000:3.0:1787893177.310562:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431480832 00000100:00100000:3.0:1787893177.310698:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 9 00000100:00100000:3.0:1787893177.310709:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f564700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bf598c2-503d-4eab-8bcc-148652504c30+7:13860:x1874741431480832:12345-192.168.202.29@tcp:41:lfs.0 00000004:00000024:3.0:1787893177.310791:0:14437:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787893177.310894:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f564700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bf598c2-503d-4eab-8bcc-148652504c30+7:13860:x1874741431480832:12345-192.168.202.29@tcp:41:lfs.0 Request processed in 179us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893177.311073:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 9 00000100:00080000:0.0:1787893177.314384:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787893177.318375:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893177.319014:0:15122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431480960 00000100:00100000:1.0:1787893177.319026:0:15122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431480960 00000100:00100000:1.0:1787893177.319106:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 5 00000100:00100000:1.0:1787893177.319116:0:15122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90700198c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0bf598c2-503d-4eab-8bcc-148652504c30+5:13860:x1874741431480960:12345-192.168.202.29@tcp:13:lfs.0 00002000:00000024:1.0:1787893177.319169:0:15122:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787893177.319265:0:15122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90700198c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0bf598c2-503d-4eab-8bcc-148652504c30+5:13860:x1874741431480960:12345-192.168.202.29@tcp:13:lfs.0 Request processed in 150us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893177.319272:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 5 00000100:00080000:2.0:1787893177.320276:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787893177.323207:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893177.323308:0:16216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431481088 00000100:00100000:0.0:1787893177.323318:0:16216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431481088 00000100:00100000:0.0:1787893177.323396:0:16216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 6 00000100:00100000:0.0:1787893177.323408:0:16216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e628a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0bf598c2-503d-4eab-8bcc-148652504c30+5:13860:x1874741431481088:12345-192.168.202.29@tcp:13:lfs.0 00002000:00000024:0.0:1787893177.323433:0:16216:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787893177.323529:0:16216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e628a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0bf598c2-503d-4eab-8bcc-148652504c30+5:13860:x1874741431481088:12345-192.168.202.29@tcp:13:lfs.0 Request processed in 122us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893177.323537:0:16216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 6 00000100:00080000:2.0:1787893177.324072:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787893177.520194:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893177.520379:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431481216 00000100:00100000:2.0:1787893177.520398:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431481216 00000100:00100000:2.0:1787893177.520488:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 93 00000100:00100000:2.0:1787893177.520499:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071075b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fa852aa-37e5-47a0-814e-47dc5f78a37a+10:13893:x1874741431481216:12345-192.168.202.29@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787893177.520517:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893177.520538:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907139b9e400/0x825e3f5022b4ba8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b2eb expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893177.520568:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907139b9e400/0x825e3f5022b4ba8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b2eb expref: 11 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893177.520579:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907139b9e400/0x825e3f5022b4ba8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b2eb expref: 11 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893177.520589:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9e400, rc 0) 00000100:00100000:2.0:1787893177.520671:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071075b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fa852aa-37e5-47a0-814e-47dc5f78a37a+11:13893:x1874741431481216:12345-192.168.202.29@tcp:101:mount.lustre.0 Request processed in 173us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893177.520695:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 93 00000100:00100000:3.0:1787893177.528206:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893177.531305:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431481344 00000100:00100000:2.0:1787893177.531322:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431481344 00000100:00100000:2.0:1787893177.531411:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 94 00000100:00100000:2.0:1787893177.531422:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071075b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fa852aa-37e5-47a0-814e-47dc5f78a37a+11:13893:x1874741431481344:12345-192.168.202.29@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787893177.531931:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071075b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fa852aa-37e5-47a0-814e-47dc5f78a37a+11:13893:x1874741431481344:12345-192.168.202.29@tcp:501:mount.lustre.0 Request processed in 508us (3737us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893177.531940:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 94 00000100:00100000:1.0:1787893177.538903:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893177.544998:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431481472 00000100:00100000:0.0:1787893177.545022:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431481472 00000100:00100000:0.0:1787893177.545573:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 95 00000100:00100000:0.0:1787893177.545588:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071075b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fa852aa-37e5-47a0-814e-47dc5f78a37a+11:13893:x1874741431481472:12345-192.168.202.29@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787893177.545933:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071075b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fa852aa-37e5-47a0-814e-47dc5f78a37a+11:13893:x1874741431481472:12345-192.168.202.29@tcp:503:mount.lustre.0 Request processed in 347us (7045us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893177.545943:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 95 00000100:00100000:3.0:1787893177.550252:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893177.556190:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431481600 00000100:00100000:1.0:1787893177.556236:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431481600 00000100:00100000:1.0:1787893177.556322:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 96 00000100:00100000:1.0:1787893177.556335:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071075b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fa852aa-37e5-47a0-814e-47dc5f78a37a+11:13899:x1874741431481600:12345-192.168.202.29@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787893177.557345:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071075b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fa852aa-37e5-47a0-814e-47dc5f78a37a+11:13899:x1874741431481600:12345-192.168.202.29@tcp:502:llog_process_th.0 Request processed in 1008us (7104us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893177.557357:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 96 00000100:00100000:2.0:1787893177.577210:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893177.577348:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431481728 00000100:00100000:0.0:1787893177.577362:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431481728 00000100:00100000:0.0:1787893177.577587:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 97 00000100:00100000:0.0:1787893177.577601:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071075b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fa852aa-37e5-47a0-814e-47dc5f78a37a+11:13899:x1874741431481728:12345-192.168.202.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787893177.581330:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071075b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fa852aa-37e5-47a0-814e-47dc5f78a37a+11:13899:x1874741431481728:12345-192.168.202.29@tcp:502:llog_process_th.0 Request processed in 466us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893177.581366:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 97 00000100:00100000:2.0:1787893177.586936:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893177.587044:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431481856 00000100:00100000:1.0:1787893177.587057:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431481856 00000100:00100000:1.0:1787893177.587140:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 98 00000100:00100000:1.0:1787893177.587153:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071075b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fa852aa-37e5-47a0-814e-47dc5f78a37a+11:13893:x1874741431481856:12345-192.168.202.29@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787893177.587177:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893177.587201:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9071421fbe00/0x825e3f5022b4ba95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b315 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893177.587237:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9071421fbe00/0x825e3f5022b4ba95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b315 expref: 12 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893177.587249:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9071421fbe00/0x825e3f5022b4ba95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b315 expref: 12 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893177.587261:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071421fbe00, rc 0) 00000100:00100000:1.0:1787893177.587342:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071075b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fa852aa-37e5-47a0-814e-47dc5f78a37a+12:13893:x1874741431481856:12345-192.168.202.29@tcp:101:mount.lustre.0 Request processed in 191us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893177.587350:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 98 00000100:00100000:3.0:1787893177.590499:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893177.590629:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431481984 00000100:00100000:1.0:1787893177.590641:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431481984 00000100:00100000:1.0:1787893177.590714:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 99 00000100:00100000:1.0:1787893177.590725:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071075b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fa852aa-37e5-47a0-814e-47dc5f78a37a+12:13893:x1874741431481984:12345-192.168.202.29@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787893177.590807:0:14430:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787893177.590828:0:14430:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787893177.590833:0:14430:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787893177.590836:0:14430:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787893177.590839:0:14430:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1787893177.593549:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071075b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fa852aa-37e5-47a0-814e-47dc5f78a37a+12:13893:x1874741431481984:12345-192.168.202.29@tcp:256:mount.lustre.0 Request processed in 2810us (3045us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893177.593566:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 99 00000100:00100000:3.0:1787893177.597668:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893177.597799:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431482112 00000100:00100000:2.0:1787893177.597821:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431482112 00000100:00100000:2.0:1787893177.597895:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 100 00000100:00100000:2.0:1787893177.597908:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9071075b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fa852aa-37e5-47a0-814e-47dc5f78a37a+12:13893:x1874741431482112:12345-192.168.202.29@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787893177.597931:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893177.597955:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907139b9f600/0x825e3f5022b4ba9c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b31c expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893177.597993:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907139b9f600/0x825e3f5022b4ba9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b31c expref: 13 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893177.598006:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907139b9f600/0x825e3f5022b4ba9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b31c expref: 13 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893177.598018:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9f600, rc 0) 00000100:00100000:2.0:1787893177.598091:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9071075b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fa852aa-37e5-47a0-814e-47dc5f78a37a+13:13893:x1874741431482112:12345-192.168.202.29@tcp:101:mount.lustre.0 Request processed in 185us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893177.598131:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 100 00000100:00100000:3.0:1787893177.600282:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893177.600386:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431482240 00000100:00100000:1.0:1787893177.600397:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431482240 00000100:00100000:1.0:1787893177.600460:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 101 00000100:00100000:1.0:1787893177.600472:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107ff3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fa852aa-37e5-47a0-814e-47dc5f78a37a+13:13893:x1874741431482240:12345-192.168.202.29@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787893177.600910:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107ff3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fa852aa-37e5-47a0-814e-47dc5f78a37a+13:13893:x1874741431482240:12345-192.168.202.29@tcp:501:mount.lustre.0 Request processed in 440us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893177.600919:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 101 00000100:00100000:3.0:1787893177.603319:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893177.603395:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431482368 00000100:00100000:1.0:1787893177.603407:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431482368 00000100:00100000:1.0:1787893177.603474:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 102 00000100:00100000:1.0:1787893177.603485:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107ff2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fa852aa-37e5-47a0-814e-47dc5f78a37a+13:13893:x1874741431482368:12345-192.168.202.29@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787893177.603795:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107ff2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fa852aa-37e5-47a0-814e-47dc5f78a37a+13:13893:x1874741431482368:12345-192.168.202.29@tcp:503:mount.lustre.0 Request processed in 311us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893177.603803:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 102 00000100:00100000:3.0:1787893177.606182:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893177.606299:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431482496 00000100:00100000:2.0:1787893177.606310:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431482496 00000100:00100000:2.0:1787893177.606368:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 103 00000100:00100000:2.0:1787893177.606379:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107ff2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fa852aa-37e5-47a0-814e-47dc5f78a37a+13:13905:x1874741431482496:12345-192.168.202.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787893177.606724:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107ff2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fa852aa-37e5-47a0-814e-47dc5f78a37a+13:13905:x1874741431482496:12345-192.168.202.29@tcp:502:llog_process_th.0 Request processed in 347us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893177.606730:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 103 00000100:00100000:3.0:1787893177.608677:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893177.608881:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431482624 00000100:00100000:1.0:1787893177.608894:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431482624 00000100:00100000:1.0:1787893177.609013:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 104 00000100:00100000:1.0:1787893177.609024:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107ff1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fa852aa-37e5-47a0-814e-47dc5f78a37a+13:13905:x1874741431482624:12345-192.168.202.29@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787893177.609355:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107ff1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fa852aa-37e5-47a0-814e-47dc5f78a37a+13:13905:x1874741431482624:12345-192.168.202.29@tcp:502:llog_process_th.0 Request processed in 332us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893177.609364:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 104 00010000:00010000:0.0:1787893177.609732:0:16140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893177.620690:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893177.620738:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893177.620819:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893177.620851:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893177.620891:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431483136 00000100:00100000:3.0:1787893177.620904:0:15120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431483136 00000100:00100000:3.0:1787893177.620970:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431483008 00000100:00100000:3.0:1787893177.620974:0:15120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431483008 00000100:00100000:3.0:1787893177.621001:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 4 00000100:00100000:3.0:1787893177.621014:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0bf598c2-503d-4eab-8bcc-148652504c30+5:2361:x1874741431483136:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1787893177.621114:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0bf598c2-503d-4eab-8bcc-148652504c30+5:2361:x1874741431483136:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 102us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893177.621132:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 4 00000100:00100000:3.0:1787893177.621151:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 5 00000100:00100000:3.0:1787893177.621158:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0bf598c2-503d-4eab-8bcc-148652504c30+5:2361:x1874741431483008:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1787893177.621186:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0bf598c2-503d-4eab-8bcc-148652504c30+5:2361:x1874741431483008:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 29us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893177.621210:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 5 00000100:00100000:2.0:1787893177.621476:0:15611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431482752 00000100:00100000:2.0:1787893177.621482:0:15611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431482752 00000100:00100000:2.0:1787893177.621518:0:15611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431482880 00000100:00100000:2.0:1787893177.621521:0:15611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431482880 00000100:00100000:2.0:1787893177.621558:0:15611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 19 00000100:00100000:2.0:1787893177.621565:0:15611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0bf598c2-503d-4eab-8bcc-148652504c30+7:2361:x1874741431482880:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1787893177.621603:0:15611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0bf598c2-503d-4eab-8bcc-148652504c30+7:2361:x1874741431482880:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 39us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893177.621610:0:15611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 19 00000100:00100000:2.0:1787893177.621623:0:15611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 10 00000100:00100000:2.0:1787893177.621628:0:15611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2359:x1874741431482752:12345-192.168.202.29@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787893177.621657:0:15611:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 002066d6-fa17-4c0c-81b6-8973035fb81a@192.168.202.29@tcp t0 exp 0000000000000000 cur 505 last 0 00000020:00000080:2.0:1787893177.621705:0:15611:0:(genops.c:1385:class_connect()) connect: client 002066d6-fa17-4c0c-81b6-8973035fb81a, cookie 0x825e3f5022b4baa3 00000004:00100000:2.0:1787893177.621747:0:15611:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787893177.621936:0:15611:0:(import.c:65:import_set_state_nolock()) ffff90712ebd2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787893177.621972:0:15611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:002066d6-fa17-4c0c-81b6-8973035fb81a+6:2359:x1874741431482752:12345-192.168.202.29@tcp:38:mount.lustre.0 Request processed in 343us (1305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893177.621987:0:15611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 10 00000100:00100000:3.0:1787893177.628056:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893177.628124:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893177.628234:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431483392 00000100:00100000:0.0:1787893177.628251:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431483392 00000100:00100000:0.0:1787893177.628344:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431483264 00000100:00100000:0.0:1787893177.628347:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431483264 00000100:00100000:0.0:1787893177.628378:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 11 00000100:00100000:0.0:1787893177.628391:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:002066d6-fa17-4c0c-81b6-8973035fb81a+7:13893:x1874741431483392:12345-192.168.202.29@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787893177.628435:0:14437:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787893177.628527:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:002066d6-fa17-4c0c-81b6-8973035fb81a+7:13893:x1874741431483392:12345-192.168.202.29@tcp:41:mount.lustre.0 Request processed in 138us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893177.628536:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 11 00000100:00100000:0.0:1787893177.628557:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 12 00000100:00100000:0.0:1787893177.628563:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:002066d6-fa17-4c0c-81b6-8973035fb81a+6:0:x1874741431483264:12345-192.168.202.29@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787893177.628574:0:14437:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787893177.628597:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:002066d6-fa17-4c0c-81b6-8973035fb81a+6:0:x1874741431483264:12345-192.168.202.29@tcp:41:mount.lustre.0 Request processed in 34us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893177.628606:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 12 00000100:00080000:3.0:1787893177.629572:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787893177.633167:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893177.633337:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431483520 00000100:00100000:0.0:1787893177.633351:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431483520 00000100:00100000:0.0:1787893177.633478:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 13 00000100:00100000:0.0:1787893177.633489:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:002066d6-fa17-4c0c-81b6-8973035fb81a+6:13893:x1874741431483520:12345-192.168.202.29@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787893177.633590:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:002066d6-fa17-4c0c-81b6-8973035fb81a+6:13893:x1874741431483520:12345-192.168.202.29@tcp:40:mount.lustre.0 Request processed in 104us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893177.633595:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 13 00000100:00100000:0.0:1787893177.640314:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893177.640433:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893177.640492:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893177.640790:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431483648 00000100:00100000:2.0:1787893177.640805:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431483648 00000100:00100000:2.0:1787893177.640859:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431483776 00000100:00100000:2.0:1787893177.640863:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431483776 00000100:00100000:2.0:1787893177.640886:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 10 00000100:00100000:2.0:1787893177.640897:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90700198c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2359:x1874741431483648:12345-192.168.202.29@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787893177.640941:0:15119:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 002066d6-fa17-4c0c-81b6-8973035fb81a@192.168.202.29@tcp t0 exp 0000000000000000 cur 505 last 0 00000020:00000080:2.0:1787893177.640996:0:15119:0:(genops.c:1385:class_connect()) connect: client 002066d6-fa17-4c0c-81b6-8973035fb81a, cookie 0x825e3f5022b4baaa 00002000:00100000:2.0:1787893177.641013:0:15119:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 002066d6-fa17-4c0c-81b6-8973035fb81a/ffff90712ebd0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787893177.641029:0:15119:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787893177.641362:0:15119:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787893177.641401:0:15119:0:(import.c:65:import_set_state_nolock()) ffff90712ebd6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787893177.641480:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90700198c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:002066d6-fa17-4c0c-81b6-8973035fb81a+6:2359:x1874741431483648:12345-192.168.202.29@tcp:8:mount.lustre.0 Request processed in 584us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893177.641488:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 10 00000100:00100000:2.0:1787893177.641509:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 11 00000100:00100000:2.0:1787893177.641514:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2359:x1874741431483776:12345-192.168.202.29@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787893177.641530:0:15119:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 002066d6-fa17-4c0c-81b6-8973035fb81a@192.168.202.29@tcp t0 exp 0000000000000000 cur 505 last 0 00000020:00000080:2.0:1787893177.641547:0:15119:0:(genops.c:1385:class_connect()) connect: client 002066d6-fa17-4c0c-81b6-8973035fb81a, cookie 0x825e3f5022b4bab1 00002000:00100000:2.0:1787893177.641552:0:15119:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 002066d6-fa17-4c0c-81b6-8973035fb81a/ffff90712ebd5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113954 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787893177.641559:0:15119:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787893177.641694:0:15119:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787893177.641723:0:15119:0:(import.c:65:import_set_state_nolock()) ffff90712ebd5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787893177.641749:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:002066d6-fa17-4c0c-81b6-8973035fb81a+6:2359:x1874741431483776:12345-192.168.202.29@tcp:8:mount.lustre.0 Request processed in 233us (1257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893177.641791:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 11 00000100:00100000:1.0:1787893177.642982:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431483904 00000100:00100000:1.0:1787893177.642996:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431483904 00000100:00100000:1.0:1787893177.643101:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1 00000100:00100000:1.0:1787893177.643111:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90700198f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:002066d6-fa17-4c0c-81b6-8973035fb81a+6:13893:x1874741431483904:12345-192.168.202.29@tcp:33:mount.lustre.0 00000004:00200000:1.0:1787893177.643389:0:14441:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1787893177.643538:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90700198f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:002066d6-fa17-4c0c-81b6-8973035fb81a+6:13893:x1874741431483904:12345-192.168.202.29@tcp:33:mount.lustre.0 Request processed in 428us (3238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893177.643547:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1 00000100:00100000:0.0:1787893177.832545:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893177.832678:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431484032 00000100:00100000:1.0:1787893177.832692:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431484032 00000100:00100000:1.0:1787893177.832808:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 14 00000100:00100000:1.0:1787893177.832822:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:002066d6-fa17-4c0c-81b6-8973035fb81a+6:13926:x1874741431484032:12345-192.168.202.29@tcp:101:mkdir.0 00010000:00010000:1.0:1787893177.832850:0:14438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893177.832883:0:14438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4bab8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b346 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893177.832964:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4babf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893177.832981:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4babf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893177.832995:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4babf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893177.833647:0:14438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787893177.833653:0:14438:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787893177.833747:0:14438:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4babf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893177.833811:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4bab8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b346 expref: 8 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893177.833835:0:14438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4babf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b346 expref: 7 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893177.833846:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9071061f7700) 00010000:00010000:1.0:1787893177.833849:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787893177.833853:0:14438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071421fa400, rc 0) 00000100:00100000:1.0:1787893177.833945:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:002066d6-fa17-4c0c-81b6-8973035fb81a+7:13926:x1874741431484032:12345-192.168.202.29@tcp:101:mkdir.0 Request processed in 1126us (1414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893177.833953:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 14 00000100:00100000:3.0:1787893178.057625:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787893178.057658:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f567b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455592960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787893178.057784:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893178.057982:0:15124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455592960 00000100:00100000:1.0:1787893178.057993:0:15124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455592960 00000100:00100000:1.0:1787893178.058084:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787893178.058096:0:15124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455592960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787893178.058380:0:15124:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787893178.058452:0:15124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455592960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 357us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893178.058460:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787893178.058624:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f567b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455592960:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787893178.633705:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893179.656939:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787893180.043209:0:14469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:2.0:1787893180.207666:0:5870:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 002066d6-fa17-4c0c-81b6-8973035fb81a 00000001:00100000:2.0:1787893180.207689:0:5870:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0bf598c2-503d-4eab-8bcc-148652504c30 00010000:00010000:2.0:1787893180.681482:0:16140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787893180.952539:0:16399:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1787893181.705306:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893182.156127:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874741455593472:0@lo:400:kworker.0 00000100:00100000:0.0:1787893182.156236:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893182.156319:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787893182.156326:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f31ac154-369d-4473-bca1-5cb1596e1d9c:3305:1874741455593088:0@lo:400:kworker.0 00000100:00100000:0.0:1787893182.156362:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893182.156393:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874741455593600:0@lo:400:kworker.0 00000100:00100000:0.0:1787893182.156419:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893182.156448:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455593216:0@lo:400:kworker.0 00000100:00100000:0.0:1787893182.156477:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893182.156497:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874741455593728:0@lo:400:kworker.0 00000100:00100000:0.0:1787893182.156518:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893182.156538:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787893182.156544:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455593344:0@lo:400:kworker.0 00000100:00100000:0.0:1787893182.156580:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893182.156621:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455593472 00000100:00100000:0.0:1787893182.156631:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455593472 00000100:00100000:0.0:1787893182.158023:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455593600 00000100:00100000:0.0:1787893182.158036:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455593600 00000100:00100000:0.0:1787893182.158086:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455593728 00000100:00100000:0.0:1787893182.158089:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455593728 00000100:00100000:0.0:1787893182.158113:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787893182.158124:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874741455593472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893182.158228:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874741455593472:12345-0@lo:400:kworker.0 Request processed in 105us (1991us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893182.158257:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787893182.158280:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787893182.158287:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874741455593600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893182.158317:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874741455593600:12345-0@lo:400:kworker.0 Request processed in 32us (1898us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893182.158324:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787893182.158336:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787893182.158342:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874741455593728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893182.158371:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874741455593728:12345-0@lo:400:kworker.0 Request processed in 30us (1853us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893182.158377:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787893182.158405:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455593088 00000100:00100000:0.0:1787893182.158410:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455593088 00000100:00100000:0.0:1787893182.158440:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787893182.158447:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107ff1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+19:3305:x1874741455593088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893182.158479:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107ff1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+19:3305:x1874741455593088:12345-0@lo:400:kworker.0 Request processed in 33us (2117us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893182.158486:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787893182.158531:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455593216 00000100:00100000:0.0:1787893182.158535:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455593216 00000100:00100000:0.0:1787893182.158565:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455593344 00000100:00100000:0.0:1787893182.158584:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455593344 00000100:00100000:0.0:1787893182.158606:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787893182.158613:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455593216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787893182.158647:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455593216:12345-0@lo:400:kworker.0 Request processed in 34us (2169us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893182.158774:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787893182.158787:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455593344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893182.158828:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455593344:12345-0@lo:400:kworker.0 Request processed in 46us (2259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893182.158834:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787893182.159241:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455593856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787893182.159304:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893182.159356:0:15122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455593856 00000100:00100000:1.0:1787893182.159360:0:15122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455593856 00000100:00100000:1.0:1787893182.159395:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787893182.159401:0:15122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f564380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455593856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787893182.159438:0:15122:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787893182.159478:0:15122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f564380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455593856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893182.159485:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787893182.159531:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1787893182.159557:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455593856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787893182.159584:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455593344:0@lo:400:kworker.0 00000100:00100000:1.0:1787893182.159598:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455593216:0@lo:400:kworker.0 00000100:00100000:1.0:1787893182.159619:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1874741455593728:0@lo:400:kworker.0 00000100:00080000:1.0:1787893182.159668:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787893182.159674:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787893182.159677:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787893182.159698:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f31ac154-369d-4473-bca1-5cb1596e1d9c:3305:1874741455593088:0@lo:400:kworker.0 00000100:00100000:1.0:1787893182.159712:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874741455593600:0@lo:400:kworker.0 00000100:00100000:1.0:1787893182.159724:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874741455593472:0@lo:400:kworker.0 00000100:00100000:0.0:1787893182.160300:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000001:00100000:3.0:1787893182.257635:0:6725:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 002066d6-fa17-4c0c-81b6-8973035fb81a 00000001:00100000:0.0:1787893182.269365:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 002066d6-fa17-4c0c-81b6-8973035fb81a 00010000:00010000:1.0:1787893182.731640:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893183.037780:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893183.037825:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893183.037854:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893183.038004:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431484160 00000100:00100000:2.0:1787893183.038019:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431484160 00000100:00100000:1.0:1787893183.038116:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893183.038146:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893183.038168:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893183.038192:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893183.038218:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431484416 00000100:00100000:1.0:1787893183.038222:0:15120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431484416 00000100:00100000:1.0:1787893183.038285:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431484928 00000100:00100000:1.0:1787893183.038289:0:15120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431484928 00000100:00100000:1.0:1787893183.038305:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431484544 00000100:00100000:1.0:1787893183.038308:0:15120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431484544 00000100:00100000:1.0:1787893183.038319:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431484800 00000100:00100000:1.0:1787893183.038322:0:15120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431484800 00000100:00100000:1.0:1787893183.038338:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 8 00000100:00100000:1.0:1787893183.038349:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f567480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0bf598c2-503d-4eab-8bcc-148652504c30+5:2363:x1874741431484416:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1787893183.038526:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 106 00000100:00100000:2.0:1787893183.038535:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107ff2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fa852aa-37e5-47a0-814e-47dc5f78a37a+13:2363:x1874741431484160:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1787893183.038588:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107ff2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fa852aa-37e5-47a0-814e-47dc5f78a37a+13:2363:x1874741431484160:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 53us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893183.038597:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 106 00000100:00100000:1.0:1787893183.040180:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f567480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0bf598c2-503d-4eab-8bcc-148652504c30+5:2363:x1874741431484416:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 1815us (2336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893183.040198:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 8 00000100:00100000:1.0:1787893183.040244:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 9 00000100:00100000:1.0:1787893183.040258:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f566d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:002066d6-fa17-4c0c-81b6-8973035fb81a+5:2363:x1874741431484928:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1787893183.040316:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f566d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:002066d6-fa17-4c0c-81b6-8973035fb81a+5:2363:x1874741431484928:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 63us (2414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893183.040323:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 9 00000100:00100000:1.0:1787893183.040336:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 10 00000100:00100000:1.0:1787893183.040344:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f564000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0bf598c2-503d-4eab-8bcc-148652504c30+5:2363:x1874741431484544:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1787893183.040371:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f564000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0bf598c2-503d-4eab-8bcc-148652504c30+5:2363:x1874741431484544:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 28us (2202us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893183.040389:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 10 00000100:00100000:1.0:1787893183.040402:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 11 00000100:00100000:1.0:1787893183.040410:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f567800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:002066d6-fa17-4c0c-81b6-8973035fb81a+5:2363:x1874741431484800:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1787893183.041640:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f567800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:002066d6-fa17-4c0c-81b6-8973035fb81a+5:2363:x1874741431484800:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 1219us (3436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893183.041653:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 11 00000100:00100000:1.0:1787893183.041691:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431484672 00000100:00100000:1.0:1787893183.041700:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431484672 00000100:00100000:1.0:1787893183.041769:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431484288 00000100:00100000:1.0:1787893183.041774:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431484288 00000100:00100000:1.0:1787893183.041802:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 23 00000100:00100000:1.0:1787893183.041809:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f567100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:002066d6-fa17-4c0c-81b6-8973035fb81a+6:2363:x1874741431484672:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1787893183.041844:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f567100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:002066d6-fa17-4c0c-81b6-8973035fb81a+6:2363:x1874741431484672:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 35us (3989us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893183.041851:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 23 00000100:00100000:1.0:1787893183.041863:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 24 00000100:00100000:1.0:1787893183.041868:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f564a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bf598c2-503d-4eab-8bcc-148652504c30+6:2363:x1874741431484288:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:1.0:1787893183.041889:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f564a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bf598c2-503d-4eab-8bcc-148652504c30+6:2363:x1874741431484288:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 21us (3744us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893183.041895:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 24 00000100:00080000:1.0:1787893183.044174:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787893183.044188:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787893183.044192:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787893183.177061:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f566680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455593984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787893183.177183:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893183.180186:0:15124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455593984 00000100:00100000:2.0:1787893183.180208:0:15124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455593984 00000100:00100000:2.0:1787893183.180298:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787893183.180313:0:15124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455593984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787893183.180364:0:15124:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787893183.184793:0:15124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455593984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4468us (7595us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893183.184826:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787893183.189669:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f566680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455593984:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787893183.753317:0:16140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787893184.798170:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787893185.112439:0:16548:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc40d81b40 20000000:00000080:2.0:1787893185.112470:0:16548:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff907104bd1400 uarg=0000000000000000 20000000:01000000:2.0:1787893185.112545:0:16548:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787893185.112555:0:16548:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787893185.112564:0:16548:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787893185.118663:0:16549:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1787893185.119607:0:16548:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787893185.130695:0:16548:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787893185.134882:0:16548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff907104f47a00/0x825e3f5022b4bac6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893185.134918:0:16548:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90710153be00/0x825e3f5022b4b7bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4b7b6 expref: 18 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893185.134928:0:16548:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90710153b400/0x825e3f5022b4b80a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4b803 expref: 18 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893185.134957:0:16548:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907137fc8600/0x825e3f5022b4b945 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4b93e expref: 18 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893185.134969:0:16548:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907139b9fa00/0x825e3f5022b4ba64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b2ba expref: 12 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893185.134976:0:16548:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff907139b9f600/0x825e3f5022b4ba9c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b31c expref: 12 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893185.134985:0:16548:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff907104f47a00/0x825e3f5022b4bac6 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893185.135271:0:16548:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907139b9f600/0x825e3f5022b4ba9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b31c expref: 12 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893185.135292:0:16548:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff907139b9f600/0x825e3f5022b4ba9c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b31c expref: 12 pid: 14432 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893185.135314:0:16548:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070038c3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16548:1874741455594112:192.168.202.29@tcp:104: 00010000:00010000:3.0:1787893185.135519:0:16548:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907139b9fa00/0x825e3f5022b4ba64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b2ba expref: 12 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893185.135529:0:16548:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff907139b9fa00/0x825e3f5022b4ba64 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b2ba expref: 12 pid: 14431 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893185.135539:0:16548:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16548:1874741455594240:192.168.202.29@tcp:104: 00010000:00010000:3.0:1787893185.135573:0:16548:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff907137fc8600/0x825e3f5022b4b945 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x825e3f5022b4b93e expref: 18 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893185.135596:0:16548:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff907137fc8600/0x825e3f5022b4b945 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x825e3f5022b4b93e expref: 18 pid: 14432 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893185.135608:0:16548:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16548:1874741455594368:0@lo:104: 00000100:00100000:3.0:1787893185.135668:0:16548:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787893185.135724:0:16548:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90710153b400/0x825e3f5022b4b80a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x825e3f5022b4b803 expref: 18 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893185.135732:0:16548:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90710153b400/0x825e3f5022b4b80a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x825e3f5022b4b803 expref: 18 pid: 14430 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893185.135741:0:16548:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16548:1874741455594496:0@lo:104: 00000100:00100000:3.0:1787893185.135805:0:16548:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787893185.135835:0:16548:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90710153be00/0x825e3f5022b4b7bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x825e3f5022b4b7b6 expref: 18 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893185.135842:0:16548:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90710153be00/0x825e3f5022b4b7bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x825e3f5022b4b7b6 expref: 18 pid: 14432 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893185.135850:0:16548:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16548:1874741455594624:0@lo:104: 00000100:00100000:3.0:1787893185.135875:0:16548:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893185.135884:0:16548:0:(client.c:2715:ptlrpc_set_wait()) set ffff907105efa840 going to sleep for 11 seconds 00000100:00100000:1.0:1787893185.136040:0:14420:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787893185.136089:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455594368 00000100:00100000:1.0:1787893185.136099:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455594368 00000100:00100000:1.0:1787893185.136149:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455594496 00000100:00100000:1.0:1787893185.136152:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455594496 00000100:00100000:1.0:1787893185.136163:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455594624 00000100:00100000:1.0:1787893185.136165:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455594624 00000100:00100000:1.0:1787893185.136178:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787893185.136189:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f31ac154-369d-4473-bca1-5cb1596e1d9c+5:16548:x1874741455594368:12345-0@lo:104: 00010000:00010000:1.0:1787893185.136205:0:14420:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff907104f47000/0x825e3f5022b4b93e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4b945 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893185.136267:0:14420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787893185.136273:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f31ac154-369d-4473-bca1-5cb1596e1d9c+5:16548:x1874741455594368:12345-0@lo:104: Request processed in 86us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893185.136281:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787893185.136302:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787893185.136307:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f31ac154-369d-4473-bca1-5cb1596e1d9c+4:16548:x1874741455594496:12345-0@lo:104: 00010000:00010000:1.0:1787893185.136315:0:14420:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff907139b9f400/0x825e3f5022b4b803 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4b80a expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893185.136348:0:14420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787893185.136352:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f31ac154-369d-4473-bca1-5cb1596e1d9c+4:16548:x1874741455594496:12345-0@lo:104: Request processed in 45us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893185.136358:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787893185.136371:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787893185.136378:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713b6c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f31ac154-369d-4473-bca1-5cb1596e1d9c+3:16548:x1874741455594624:12345-0@lo:104: 00010000:00010000:1.0:1787893185.136385:0:14420:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.129@tcp lock: ffff907137fc8a00/0x825e3f5022b4b7b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4b7bd expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893185.136432:0:14420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787893185.136438:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713b6c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f31ac154-369d-4473-bca1-5cb1596e1d9c+3:16548:x1874741455594624:12345-0@lo:104: Request processed in 61us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893185.136445:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1787893185.136505:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787893185.136513:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff907104f47000/0x825e3f5022b4b93e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4b945 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893185.136524:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f47000 already unused, calling callback (ffffffffc1c05c20) 10000000:00010000:1.0:1787893185.136529:0:14426:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff907104f47000/0x825e3f5022b4b93e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x825e3f5022b4b945 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893185.136541:0:14426:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff907104f47000/0x825e3f5022b4b93e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x825e3f5022b4b945 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787893185.136550:0:14426:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff907104f47000/0x825e3f5022b4b93e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x825e3f5022b4b945 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893185.136557:0:14426:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787893185.136602:0:14426:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff907104f47000/0x825e3f5022b4b93e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4b945 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893185.136610:0:14426:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787893185.136636:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff907104f47000/0x825e3f5022b4b93e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4b945 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893185.136645:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff907104f47000/0x825e3f5022b4b93e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4b945 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893185.136676:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787893185.136679:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff907139b9f400/0x825e3f5022b4b803 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4b80a expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893185.136685:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9f400 already unused, calling callback (ffffffffc1c05c20) 10000000:00010000:1.0:1787893185.136688:0:14426:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff907139b9f400/0x825e3f5022b4b803 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x825e3f5022b4b80a expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893185.136695:0:14426:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff907139b9f400/0x825e3f5022b4b803 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x825e3f5022b4b80a expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787893185.136702:0:14426:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff907139b9f400/0x825e3f5022b4b803 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x825e3f5022b4b80a expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893185.136709:0:14426:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787893185.136723:0:14426:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff907139b9f400/0x825e3f5022b4b803 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4b80a expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893185.136729:0:14426:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787893185.136747:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff907139b9f400/0x825e3f5022b4b803 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4b80a expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893185.136783:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff907139b9f400/0x825e3f5022b4b803 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4b80a expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893185.136794:0:14426:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893185.136798:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.129@tcp lock: ffff907137fc8a00/0x825e3f5022b4b7b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x825e3f5022b4b7bd expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893185.136813:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc8a00 already unused, calling callback (ffffffffc1c05c20) 10000000:00010000:1.0:1787893185.136816:0:14426:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.129@tcp lock: ffff907137fc8a00/0x825e3f5022b4b7b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x825e3f5022b4b7bd expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893185.136822:0:14426:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.129@tcp lock: ffff907137fc8a00/0x825e3f5022b4b7b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x825e3f5022b4b7bd expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787893185.136828:0:14426:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.129@tcp lock: ffff907137fc8a00/0x825e3f5022b4b7b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x825e3f5022b4b7bd expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787893185.136833:0:14426:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787893185.136848:0:14426:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.129@tcp lock: ffff907137fc8a00/0x825e3f5022b4b7b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4b7bd expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893185.136853:0:14426:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787893185.136859:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.129@tcp lock: ffff907137fc8a00/0x825e3f5022b4b7b6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4b7bd expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893185.136865:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.129@tcp lock: ffff907137fc8a00/0x825e3f5022b4b7b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x825e3f5022b4b7bd expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893185.136881:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893185.136883:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893185.136885:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893185.136894:0:16140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893185.136901:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787893185.136925:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f565180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f31ac154-369d-4473-bca1-5cb1596e1d9c:3306:1874741455594752:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787893185.136968:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893185.137015:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f565500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f31ac154-369d-4473-bca1-5cb1596e1d9c:3307:1874741455594880:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787893185.137060:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893185.137083:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787893185.137090:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f566a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f31ac154-369d-4473-bca1-5cb1596e1d9c:3307:1874741455595008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787893185.137118:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893185.137161:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455594752 00000100:00100000:1.0:1787893185.137167:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455594752 00010000:00010000:1.0:1787893185.137192:0:14424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907137fc8600/0x825e3f5022b4b945 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4b93e expref: 19 pid: 14432 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893185.137211:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455594880 00000100:00100000:1.0:1787893185.137215:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455594880 00010000:00010000:1.0:1787893185.137226:0:14424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90710153b400/0x825e3f5022b4b80a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4b803 expref: 20 pid: 14430 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893185.137238:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455595008 00000100:00100000:1.0:1787893185.137241:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455595008 00010000:00010000:1.0:1787893185.137251:0:14424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90710153be00/0x825e3f5022b4b7bd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4b7b6 expref: 21 pid: 14432 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893185.137265:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787893185.137273:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f565f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f31ac154-369d-4473-bca1-5cb1596e1d9c+21:3306:x1874741455594752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787893185.137285:0:14424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893185.137291:0:14424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907137fc8600/0x825e3f5022b4b945 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4b93e expref: 21 pid: 14432 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893185.137303:0:14424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907137fc8600/0x825e3f5022b4b945 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x825e3f5022b4b93e expref: 21 pid: 14432 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893185.137322:0:14424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893185.137351:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f565f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f31ac154-369d-4473-bca1-5cb1596e1d9c+21:3306:x1874741455594752:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893185.137364:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787893185.137382:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787893185.137388:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f566300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f31ac154-369d-4473-bca1-5cb1596e1d9c+20:3307:x1874741455594880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787893185.137395:0:14424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893185.137400:0:14424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90710153b400/0x825e3f5022b4b80a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4b803 expref: 20 pid: 14430 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893185.137408:0:14424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90710153b400/0x825e3f5022b4b80a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x825e3f5022b4b803 expref: 20 pid: 14430 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893185.137418:0:14424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893185.137443:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f566300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f31ac154-369d-4473-bca1-5cb1596e1d9c+20:3307:x1874741455594880:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893185.137449:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787893185.137462:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787893185.137469:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f42b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f31ac154-369d-4473-bca1-5cb1596e1d9c+19:3307:x1874741455595008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787893185.137476:0:14424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893185.137479:0:14424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90710153be00/0x825e3f5022b4b7bd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x825e3f5022b4b7b6 expref: 19 pid: 14432 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893185.137487:0:14424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90710153be00/0x825e3f5022b4b7bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x825e3f5022b4b7b6 expref: 19 pid: 14432 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893185.137497:0:14424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893185.137518:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f42b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f31ac154-369d-4473-bca1-5cb1596e1d9c+19:3307:x1874741455595008:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893185.137524:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787893185.137598:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f565180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f31ac154-369d-4473-bca1-5cb1596e1d9c:3306:1874741455594752:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787893185.137635:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f566a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f31ac154-369d-4473-bca1-5cb1596e1d9c:3307:1874741455595008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787893185.137642:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f565500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f31ac154-369d-4473-bca1-5cb1596e1d9c:3307:1874741455594880:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787893185.139437:0:16548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907137fc8600/0x825e3f5022b4b945 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x825e3f5022b4b93e expref: 18 pid: 14432 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893185.139467:0:16548:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16548:1874741455594368:0@lo:104: 00010000:00010000:3.0:1787893185.139482:0:16548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90710153b400/0x825e3f5022b4b80a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x825e3f5022b4b803 expref: 17 pid: 14430 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893185.139525:0:16548:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16548:1874741455594496:0@lo:104: 00010000:00010000:3.0:1787893185.139539:0:16548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90710153be00/0x825e3f5022b4b7bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x825e3f5022b4b7b6 expref: 16 pid: 14432 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893185.139546:0:16548:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16548:1874741455594624:0@lo:104: 00000100:00100000:2.0:1787893185.151461:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893185.151565:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431485056 00000100:00100000:0.0:1787893185.151583:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431485056 00010000:00010000:0.0:1787893185.151650:0:14424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907139b9f600/0x825e3f5022b4ba9c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b31c expref: 13 pid: 14432 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893185.151711:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 7 00000100:00100000:0.0:1787893185.151725:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e62a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fa852aa-37e5-47a0-814e-47dc5f78a37a+13:2360:x1874741431485056:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893185.151779:0:14424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893185.151789:0:14424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907139b9f600/0x825e3f5022b4ba9c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b31c expref: 13 pid: 14432 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893185.151808:0:14424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907139b9f600/0x825e3f5022b4ba9c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b31c expref: 13 pid: 14432 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893185.151847:0:14424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893185.151925:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e62a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5fa852aa-37e5-47a0-814e-47dc5f78a37a+13:2360:x1874741431485056:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 204us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893185.151933:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 7 00010000:00010000:3.0:1787893185.153278:0:16548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907139b9f600/0x825e3f5022b4ba9c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b31c expref: 12 pid: 14432 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893185.153306:0:16548:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070038c3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16548:1874741455594112:192.168.202.29@tcp:104: 00000100:00100000:3.0:1787893185.153322:0:16548:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16548:1874741455594240:192.168.202.29@tcp:104: 00010000:00010000:3.0:1787893185.153663:0:16548:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff907104f47a00/0x825e3f5022b4bac6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893185.153729:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893185.153799:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431485184 00000100:00100000:1.0:1787893185.153808:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431485184 00010000:00010000:1.0:1787893185.153848:0:14422:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff907139b9fa00/0x825e3f5022b4ba64 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b2ba expref: 12 pid: 14431 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893185.153877:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 8 00000100:00100000:1.0:1787893185.153886:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fa852aa-37e5-47a0-814e-47dc5f78a37a+12:2360:x1874741431485184:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893185.153907:0:14422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893185.153914:0:14422:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff907139b9fa00/0x825e3f5022b4ba64 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b2ba expref: 12 pid: 14431 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893185.153923:0:14422:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff907139b9fa00/0x825e3f5022b4ba64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b2ba expref: 12 pid: 14431 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893185.153940:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907139b9fa00/0x825e3f5022b4ba64 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b2ba expref: 12 pid: 14431 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893185.153954:0:14422:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff907104f47a00/0x825e3f5022b4bac6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893185.153965:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907104f47a00/0x825e3f5022b4bac6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893185.153982:0:14422:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907104f47a00/0x825e3f5022b4bac6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893185.153990:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff907104f47a00/0x825e3f5022b4bac6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893185.154016:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff907104f47a00/0x825e3f5022b4bac6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893185.154024:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff907104f47a00/0x825e3f5022b4bac6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893185.154032:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f47a00 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:1.0:1787893185.154037:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff907104f47a00/0x825e3f5022b4bac6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893185.154199:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff907104f47a00/0x825e3f5022b4bac6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893185.154220:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff907104f47a00/0x825e3f5022b4bac6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893185.154232:0:14422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893185.154289:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5fa852aa-37e5-47a0-814e-47dc5f78a37a+11:2360:x1874741431485184:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 404us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893185.154295:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 8 00010000:00010000:3.0:1787893185.154555:0:16548:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff907104f47a00/0x825e3f5022b4bac6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893185.154564:0:16548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff907104f47a00/0x825e3f5022b4bac6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893185.154570:0:16548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff907104f47a00/0x825e3f5022b4bac6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893185.810737:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893186.295996:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893186.296089:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431485312 00000100:00100000:0.0:1787893186.296103:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431485312 00000100:00100000:0.0:1787893186.296180:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 107 00000100:00100000:0.0:1787893186.296194:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107ff0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fa852aa-37e5-47a0-814e-47dc5f78a37a+11:13777:x1874741431485312:12345-192.168.202.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787893186.296235:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893186.296264:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907137fc9400/0x825e3f5022b4bacd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b34d expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893186.296302:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907137fc9400/0x825e3f5022b4bacd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b34d expref: 12 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893186.296315:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907137fc9400/0x825e3f5022b4bacd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b34d expref: 12 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893186.296326:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907137fc9400, rc 0) 00000100:00100000:0.0:1787893186.296410:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107ff0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fa852aa-37e5-47a0-814e-47dc5f78a37a+12:13777:x1874741431485312:12345-192.168.202.29@tcp:101:ll_cfg_requeue.0 Request processed in 220us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893186.296418:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 107 00000100:00100000:2.0:1787893186.300158:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893186.300253:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431485440 00000100:00100000:0.0:1787893186.300267:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431485440 00000100:00100000:0.0:1787893186.300344:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 108 00000100:00100000:0.0:1787893186.300357:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107ff3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fa852aa-37e5-47a0-814e-47dc5f78a37a+12:13777:x1874741431485440:12345-192.168.202.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787893186.300845:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107ff3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fa852aa-37e5-47a0-814e-47dc5f78a37a+12:13777:x1874741431485440:12345-192.168.202.29@tcp:501:ll_cfg_requeue.0 Request processed in 489us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893186.300853:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 108 00000100:00100000:1.0:1787893186.307862:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893186.308697:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431485568 00000100:00100000:3.0:1787893186.308714:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431485568 00000100:00100000:3.0:1787893186.308822:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 109 00000100:00100000:3.0:1787893186.308834:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107ff2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fa852aa-37e5-47a0-814e-47dc5f78a37a+12:13777:x1874741431485568:12345-192.168.202.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787893186.317129:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107ff2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fa852aa-37e5-47a0-814e-47dc5f78a37a+12:13777:x1874741431485568:12345-192.168.202.29@tcp:503:ll_cfg_requeue.0 Request processed in 8279us (9262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893186.317166:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 109 00000100:00100000:0.0:1787893186.331538:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893186.331639:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431485696 00000100:00100000:3.0:1787893186.331653:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431485696 00000100:00100000:3.0:1787893186.331724:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 110 00000100:00100000:3.0:1787893186.331737:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107ff0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fa852aa-37e5-47a0-814e-47dc5f78a37a+12:13777:x1874741431485696:12345-192.168.202.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787893186.331789:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893186.331814:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907104f47a00/0x825e3f5022b4bad4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b354 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893186.331850:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907104f47a00/0x825e3f5022b4bad4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b354 expref: 13 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893186.331862:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907104f47a00/0x825e3f5022b4bad4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b354 expref: 13 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893186.331874:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907104f47a00, rc 0) 00000100:00100000:3.0:1787893186.332150:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107ff0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fa852aa-37e5-47a0-814e-47dc5f78a37a+13:13777:x1874741431485696:12345-192.168.202.29@tcp:101:ll_cfg_requeue.0 Request processed in 414us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893186.332159:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 110 00000100:00100000:2.0:1787893186.343731:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893186.343797:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431485824 00000100:00100000:2.0:1787893186.343809:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431485824 00000100:00100000:2.0:1787893186.343875:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 111 00000100:00100000:2.0:1787893186.343887:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107ff0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fa852aa-37e5-47a0-814e-47dc5f78a37a+13:13777:x1874741431485824:12345-192.168.202.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787893186.345494:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107ff0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fa852aa-37e5-47a0-814e-47dc5f78a37a+13:13777:x1874741431485824:12345-192.168.202.29@tcp:501:ll_cfg_requeue.0 Request processed in 1599us (1768us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893186.345509:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 111 00000100:00100000:0.0:1787893186.355459:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893186.355550:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431485952 00000100:00100000:2.0:1787893186.355564:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431485952 00000100:00100000:2.0:1787893186.355640:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 112 00000100:00100000:2.0:1787893186.355652:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107ff0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fa852aa-37e5-47a0-814e-47dc5f78a37a+13:13777:x1874741431485952:12345-192.168.202.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787893186.355977:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107ff0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5fa852aa-37e5-47a0-814e-47dc5f78a37a+13:13777:x1874741431485952:12345-192.168.202.29@tcp:503:ll_cfg_requeue.0 Request processed in 326us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893186.355986:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 112 10000000:01000000:1.0:1787893186.700687:0:14434:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787893186.700699:0:14434:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff907113d05800 from 10 10000000:01000000:1.0:1787893186.700707:0:14434:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787893186.702678:0:14434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff9071421fac00/0x825e3f5022b4badb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893186.702703:0:14434:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff9071421fac00/0x825e3f5022b4badb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893186.702746:0:14434:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff9071421fac00/0x825e3f5022b4badb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893186.702798:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f565500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f31ac154-369d-4473-bca1-5cb1596e1d9c:14434:1874741455595136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787893186.702896:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893186.702966:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff907109132540 going to sleep for 11 seconds 00000100:00100000:1.0:1787893186.704317:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455595136 00000100:00100000:1.0:1787893186.704334:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455595136 00000100:00100000:1.0:1787893186.704414:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787893186.704426:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107ff3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+16:14434:x1874741455595136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787893186.704450:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893186.704475:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9071421fa200/0x825e3f5022b4bae2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4badb expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893186.704509:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9071421fa200/0x825e3f5022b4bae2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4badb expref: 17 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893186.704522:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9071421fa200/0x825e3f5022b4bae2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4badb expref: 17 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893186.705326:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071421fa200, rc 0) 00000100:00100000:1.0:1787893186.705625:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107ff3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+17:14434:x1874741455595136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1197us (2726us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893186.705635:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787893186.709879:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f565500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f31ac154-369d-4473-bca1-5cb1596e1d9c:14434:1874741455595136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787893186.709921:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff9071421fac00/0x825e3f5022b4badb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4bae2 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893186.709937:0:14434:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff9071421fac00/0x825e3f5022b4badb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4bae2 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893186.710180:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d3e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f31ac154-369d-4473-bca1-5cb1596e1d9c:14434:1874741455595264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787893186.710263:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893186.710317:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455595264 00000100:00100000:0.0:1787893186.710334:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455595264 00000100:00100000:0.0:1787893186.710392:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787893186.710403:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107ff1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+17:14434:x1874741455595264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787893186.711174:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107ff1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+17:14434:x1874741455595264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 769us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893186.711185:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787893186.711247:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710821f240 going to sleep for 11 seconds 00000100:00100000:0.0:1787893186.711267:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d3e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f31ac154-369d-4473-bca1-5cb1596e1d9c:14434:1874741455595264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787893186.711312:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d3e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f31ac154-369d-4473-bca1-5cb1596e1d9c:14434:1874741455595392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787893186.711363:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893186.711390:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710821f240 going to sleep for 11 seconds 00000100:00100000:3.0:1787893186.711577:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455595392 00000100:00100000:3.0:1787893186.711590:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455595392 00000100:00100000:3.0:1787893186.711628:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787893186.711636:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907107ff3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+17:14434:x1874741455595392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787893186.711849:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907107ff3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+17:14434:x1874741455595392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 213us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893186.711856:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787893186.711905:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d3e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f31ac154-369d-4473-bca1-5cb1596e1d9c:14434:1874741455595392:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787893186.716795:0:16610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787893186.716884:0:14434:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787893186.716907:0:14434:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787893186.716922:0:14434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff9071421fac00/0x825e3f5022b4badb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4bae2 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893186.716937:0:14434:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff9071421fac00/0x825e3f5022b4badb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4bae2 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787893186.716950:0:14434:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787893186.716953:0:14434:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90712c5fa000 from 10 10000000:01000000:3.0:1787893186.716957:0:14434:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787893186.717088:0:14434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff907104f47400/0x825e3f5022b4bae9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893186.717097:0:14434:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff907104f47400/0x825e3f5022b4bae9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893186.717113:0:14434:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff907104f47400/0x825e3f5022b4bae9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893186.717148:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f31ac154-369d-4473-bca1-5cb1596e1d9c:14434:1874741455595520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787893186.717257:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893186.717306:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071298b4600 going to sleep for 11 seconds 00000100:00100000:3.0:1787893186.717335:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455595520 00000100:00100000:3.0:1787893186.717345:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455595520 00000100:00100000:3.0:1787893186.717402:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787893186.717414:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907106343450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+17:14434:x1874741455595520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787893186.717432:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893186.717448:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907104f46c00/0x825e3f5022b4baf0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4bae9 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893186.717476:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907104f46c00/0x825e3f5022b4baf0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4bae9 expref: 18 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893186.717488:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907104f46c00/0x825e3f5022b4baf0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4bae9 expref: 18 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893186.717499:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907104f46c00, rc 0) 00000100:00100000:3.0:1787893186.717543:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907106343450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+18:14434:x1874741455595520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893186.717550:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787893186.717608:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f31ac154-369d-4473-bca1-5cb1596e1d9c:14434:1874741455595520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787893186.717624:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff907104f47400/0x825e3f5022b4bae9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4baf0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893186.717633:0:14434:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff907104f47400/0x825e3f5022b4bae9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4baf0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893186.717685:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f31ac154-369d-4473-bca1-5cb1596e1d9c:14434:1874741455595648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787893186.717718:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893186.717742:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071298b4600 going to sleep for 11 seconds 00000100:00100000:1.0:1787893186.719180:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455595648 00000100:00100000:1.0:1787893186.719197:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455595648 00000100:00100000:1.0:1787893186.719258:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787893186.719268:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907106341850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+18:14434:x1874741455595648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787893186.719664:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907106341850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+18:14434:x1874741455595648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 396us (1943us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893186.719673:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787893186.719739:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f31ac154-369d-4473-bca1-5cb1596e1d9c:14434:1874741455595648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787893186.719834:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f566a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f31ac154-369d-4473-bca1-5cb1596e1d9c:14434:1874741455595776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787893186.719887:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893186.719922:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff907108643cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787893186.719938:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455595776 00000100:00100000:1.0:1787893186.719942:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455595776 00000100:00100000:1.0:1787893186.719967:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787893186.719973:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907106342050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+18:14434:x1874741455595776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787893186.720175:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907106342050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+18:14434:x1874741455595776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 201us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893186.720183:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787893186.720222:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f566a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f31ac154-369d-4473-bca1-5cb1596e1d9c:14434:1874741455595776:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787893186.725696:0:16612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787893186.728838:0:14434:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787893186.728890:0:14434:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787893186.728906:0:14434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff907104f47400/0x825e3f5022b4bae9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4baf0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893186.728921:0:14434:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff907104f47400/0x825e3f5022b4bae9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4baf0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787893186.728934:0:14434:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787893186.728937:0:14434:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9071087e7000 from 10 10000000:01000000:0.0:1787893186.728941:0:14434:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787893186.728991:0:14434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.129@tcp lock: ffff907137fc8600/0x825e3f5022b4baf7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893186.732130:0:14434:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.129@tcp lock: ffff907137fc8600/0x825e3f5022b4baf7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893186.732154:0:14434:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.129@tcp lock: ffff907137fc8600/0x825e3f5022b4baf7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893186.732201:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d3df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f31ac154-369d-4473-bca1-5cb1596e1d9c:14434:1874741455595904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787893186.732303:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893186.732371:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710821f240 going to sleep for 11 seconds 00000100:00100000:0.0:1787893186.732413:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455595904 00000100:00100000:0.0:1787893186.732423:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455595904 00000100:00100000:0.0:1787893186.732484:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787893186.732494:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907106341c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+18:14434:x1874741455595904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787893186.732511:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893186.732532:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff907137fc9000/0x825e3f5022b4bafe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x825e3f5022b4baf7 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893186.732562:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff907137fc9000/0x825e3f5022b4bafe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x825e3f5022b4baf7 expref: 19 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893186.732574:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff907137fc9000/0x825e3f5022b4bafe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x825e3f5022b4baf7 expref: 19 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893186.732584:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907137fc9000, rc 0) 00000100:00100000:0.0:1787893186.732627:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907106341c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+19:14434:x1874741455595904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893186.732634:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787893186.732694:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d3df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f31ac154-369d-4473-bca1-5cb1596e1d9c:14434:1874741455595904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787893186.732710:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.129@tcp lock: ffff907137fc8600/0x825e3f5022b4baf7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4bafe expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893186.732720:0:14434:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.129@tcp lock: ffff907137fc8600/0x825e3f5022b4baf7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x825e3f5022b4bafe expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893186.732815:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d3df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f31ac154-369d-4473-bca1-5cb1596e1d9c:14434:1874741455596032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787893186.732841:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787893186.732866:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710821f240 going to sleep for 11 seconds 00000100:00100000:3.0:1787893186.734430:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455596032 00000100:00100000:3.0:1787893186.734444:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455596032 00000100:00100000:3.0:1787893186.734502:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787893186.734513:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907106340050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+19:14434:x1874741455596032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787893186.734886:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907106340050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+19:14434:x1874741455596032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 375us (2043us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893186.734895:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787893186.734956:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d3df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f31ac154-369d-4473-bca1-5cb1596e1d9c:14434:1874741455596032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787893186.735445:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f31ac154-369d-4473-bca1-5cb1596e1d9c:14434:1874741455596160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787893186.735500:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893186.735575:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff90710a531840 going to sleep for 11 seconds 00000100:00100000:0.0:1787893186.742897:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455596160 00000100:00100000:0.0:1787893186.742916:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455596160 00000100:00100000:0.0:1787893186.744576:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787893186.744606:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907106342850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+19:14434:x1874741455596160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787893186.744960:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907106342850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f31ac154-369d-4473-bca1-5cb1596e1d9c+19:14434:x1874741455596160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 366us (9459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893186.757138:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787893186.778672:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f31ac154-369d-4473-bca1-5cb1596e1d9c:14434:1874741455596160:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787893186.797539:0:16616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787893186.798108:0:14434:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787893186.798142:0:14434:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787893186.798157:0:14434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.129@tcp lock: ffff907137fc8600/0x825e3f5022b4baf7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4bafe expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893186.798173:0:14434:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.129@tcp lock: ffff907137fc8600/0x825e3f5022b4baf7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x825e3f5022b4bafe expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893186.824946:0:16140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893187.273320:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787893187.273368:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455596288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787893187.273465:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893187.273583:0:16216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455596288 00000100:00100000:3.0:1787893187.273593:0:16216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455596288 00000100:00100000:3.0:1787893187.273662:0:16216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787893187.273675:0:16216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455596288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787893187.273720:0:16216:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787893187.273799:0:16216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455596288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893187.273807:0:16216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1787893187.273835:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787893187.273876:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455596288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787893187.275459:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455596544:0@lo:400:kworker.0 00000100:00100000:3.0:1787893187.275543:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893187.275582:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787893187.275588:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874741455596672:0@lo:400:kworker.0 00000100:00100000:3.0:1787893187.275616:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893187.275653:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455596544 00000100:00100000:3.0:1787893187.275662:0:15120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455596544 00000100:00100000:3.0:1787893187.275727:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787893187.275738:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455596544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893187.275807:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455596544:12345-0@lo:400:kworker.0 Request processed in 71us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893187.275815:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787893187.275840:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455596672 00000100:00100000:3.0:1787893187.275844:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455596672 00000100:00100000:3.0:1787893187.275873:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787893187.275881:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874741455596672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893187.275911:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874741455596672:12345-0@lo:400:kworker.0 Request processed in 31us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893187.275933:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787893187.275959:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874741455596800:0@lo:400:kworker.0 00000100:00100000:3.0:1787893187.276011:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893187.276043:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787893187.276048:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f31ac154-369d-4473-bca1-5cb1596e1d9c:3305:1874741455596416:0@lo:400:kworker.0 00000100:00100000:3.0:1787893187.276081:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893187.276110:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874741455596928:0@lo:400:kworker.0 00000100:00100000:3.0:1787893187.276136:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893187.276163:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455596800 00000100:00100000:3.0:1787893187.276167:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455596800 00000100:00100000:3.0:1787893187.276192:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455596928 00000100:00100000:3.0:1787893187.276195:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455596928 00000100:00100000:3.0:1787893187.276213:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787893187.276219:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874741455596800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893187.276252:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874741455596800:12345-0@lo:400:kworker.0 Request processed in 33us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893187.276259:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787893187.276274:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787893187.276280:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874741455596928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893187.276307:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874741455596928:12345-0@lo:400:kworker.0 Request processed in 28us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893187.276313:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787893187.276333:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455596416 00000100:00100000:3.0:1787893187.276337:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455596416 00000100:00100000:3.0:1787893187.276363:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787893187.276371:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907106340c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+19:3305:x1874741455596416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893187.276409:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907106340c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f31ac154-369d-4473-bca1-5cb1596e1d9c+19:3305:x1874741455596416:12345-0@lo:400:kworker.0 Request processed in 40us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893187.276416:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:3.0:1787893187.276447:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787893187.276453:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787893187.276488:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874741455596672:0@lo:400:kworker.0 00000100:00100000:3.0:1787893187.276501:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455596544:0@lo:400:kworker.0 00000100:00100000:3.0:1787893187.276537:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f31ac154-369d-4473-bca1-5cb1596e1d9c:3305:1874741455596416:0@lo:400:kworker.0 00000100:00100000:3.0:1787893187.276546:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874741455596928:0@lo:400:kworker.0 00000100:00100000:3.0:1787893187.276555:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1874741455596800:0@lo:400:kworker.0 00010000:00010000:0.0:1787893187.857357:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893188.146884:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893188.146942:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893188.146979:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893188.147035:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893188.147062:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893188.147302:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431486080 00000100:00100000:0.0:1787893188.147313:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431486080 00000100:00100000:0.0:1787893188.147364:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 123 00000100:00100000:0.0:1787893188.147374:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907106343850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fa852aa-37e5-47a0-814e-47dc5f78a37a+13:2360:x1874741431486080:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1787893188.147470:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907106343850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5fa852aa-37e5-47a0-814e-47dc5f78a37a+13:2360:x1874741431486080:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 84us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893188.147478:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 123 00000100:00100000:0.0:1787893188.147614:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431486336 00000100:00100000:0.0:1787893188.147618:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431486336 00000100:00100000:0.0:1787893188.147649:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431486848 00000100:00100000:0.0:1787893188.147652:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431486848 00000100:00100000:0.0:1787893188.147670:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 13 00000100:00100000:0.0:1787893188.147677:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0bf598c2-503d-4eab-8bcc-148652504c30+5:2360:x1874741431486336:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1787893188.147709:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e629c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0bf598c2-503d-4eab-8bcc-148652504c30+5:2360:x1874741431486336:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 32us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893188.147723:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 13 00000100:00100000:0.0:1787893188.147735:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 14 00000100:00100000:0.0:1787893188.147742:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e629f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:002066d6-fa17-4c0c-81b6-8973035fb81a+5:2360:x1874741431486848:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1787893188.147816:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e629f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:002066d6-fa17-4c0c-81b6-8973035fb81a+5:2360:x1874741431486848:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 75us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893188.147823:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 14 00000100:00100000:2.0:1787893188.149603:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893188.149694:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893188.150101:0:15850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431486464 00000100:00100000:3.0:1787893188.150111:0:15850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431486464 00000100:00100000:3.0:1787893188.150150:0:15850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431486720 00000100:00100000:3.0:1787893188.150152:0:15850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431486720 00000100:00100000:3.0:1787893188.150166:0:15850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 15 00000100:00100000:3.0:1787893188.150174:0:15850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f537b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0bf598c2-503d-4eab-8bcc-148652504c30+5:2360:x1874741431486464:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1787893188.150372:0:15850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f537b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0bf598c2-503d-4eab-8bcc-148652504c30+5:2360:x1874741431486464:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 197us (3278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893188.150380:0:15850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 15 00000100:00100000:3.0:1787893188.150398:0:15850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 16 00000100:00100000:3.0:1787893188.150405:0:15850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f535500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:002066d6-fa17-4c0c-81b6-8973035fb81a+5:2360:x1874741431486720:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1787893188.150431:0:15850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f535500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:002066d6-fa17-4c0c-81b6-8973035fb81a+5:2360:x1874741431486720:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 27us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893188.150456:0:15850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 16 00000100:00100000:3.0:1787893188.150507:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431486592 00000100:00100000:3.0:1787893188.150511:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431486592 00000100:00100000:3.0:1787893188.150540:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431486208 00000100:00100000:3.0:1787893188.150544:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431486208 00000100:00100000:3.0:1787893188.150564:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 28 00000100:00100000:3.0:1787893188.150571:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:002066d6-fa17-4c0c-81b6-8973035fb81a+6:2360:x1874741431486592:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1787893188.150600:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:002066d6-fa17-4c0c-81b6-8973035fb81a+6:2360:x1874741431486592:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 29us (3620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893188.150607:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 28 00000100:00100000:3.0:1787893188.150619:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 29 00000100:00100000:3.0:1787893188.150625:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f535c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bf598c2-503d-4eab-8bcc-148652504c30+6:2360:x1874741431486208:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1787893188.150648:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f535c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bf598c2-503d-4eab-8bcc-148652504c30+6:2360:x1874741431486208:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 23us (3585us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893188.150654:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 29 00000100:00080000:3.0:1787893188.150682:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787893188.150687:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787893188.150689:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787893188.299415:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f566a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455597056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787893188.299535:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893188.299813:0:15124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455597056 00000100:00100000:1.0:1787893188.299825:0:15124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455597056 00000100:00100000:1.0:1787893188.299886:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787893188.299897:0:15124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455597056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787893188.299942:0:15124:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787893188.300034:0:15124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874741455597056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893188.300041:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787893188.300331:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f566a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1874741455597056:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787893188.874045:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787893189.219472:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893189.219623:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431486976 00000100:00100000:3.0:1787893189.219635:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431486976 00000100:00100000:3.0:1787893189.219731:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 15 00000100:00100000:3.0:1787893189.219744:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bf598c2-503d-4eab-8bcc-148652504c30+6:14436:x1874741431486976:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787893189.219817:0:14438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893189.219845:0:14438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46400/0x825e3f5022b4bb05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b35b expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.219930:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bb0c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.219947:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bb0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.219958:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bb0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.219973:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4bb13 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.219991:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4bb13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.219997:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4bb13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.220548:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4bb1a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.220559:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4bb1a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.220568:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4bb1a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893189.220656:0:14438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787893189.220667:0:14438:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787893189.220812:0:14438:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4bb1a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.220828:0:14438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bb0c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.220834:0:14438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bb0c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.220842:0:14438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bb0c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.220849:0:14438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f46200 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893189.220853:0:14438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bb0c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.220863:0:14438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bb0c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.220879:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9071061f7700) 00010000:00010000:3.0:1787893189.220882:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893189.220888:0:14438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bb0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.220894:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bb0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.220907:0:14438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4bb13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.220913:0:14438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4bb13 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.220930:0:14438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4bb13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.220935:0:14438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f47200 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893189.220938:0:14438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4bb13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.220944:0:14438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4bb13 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.220953:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff907102b84800) 00010000:00010000:3.0:1787893189.220955:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893189.220958:0:14438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4bb13 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.220963:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4bb13 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.220997:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46400/0x825e3f5022b4bb05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b35b expref: 8 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.221022:0:14438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47800/0x825e3f5022b4bb1a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b35b expref: 7 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.221030:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff907102b84200) 00010000:00010000:3.0:1787893189.221032:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787893189.221035:0:14438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907104f47800, rc 0) 00000100:00100000:3.0:1787893189.221109:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f536a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bf598c2-503d-4eab-8bcc-148652504c30+7:14436:x1874741431486976:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 Request processed in 1367us (1649us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893189.221125:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 15 00000100:00100000:1.0:1787893189.234893:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893189.235228:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431487232 00000100:00100000:3.0:1787893189.235243:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431487232 00000100:00100000:3.0:1787893189.235332:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 16 00000100:00100000:3.0:1787893189.235345:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f565180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bf598c2-503d-4eab-8bcc-148652504c30+7:14436:x1874741431487232:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787893189.235375:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893189.235406:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46400/0x825e3f5022b4bb21 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b362 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.235528:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4bb28 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.235546:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4bb28 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.235572:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4bb28 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.250622:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bb2f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.250646:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bb2f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.250663:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bb2f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.251280:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f000/0x825e3f5022b4bb36 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.251290:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f000/0x825e3f5022b4bb36 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.251299:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f000/0x825e3f5022b4bb36 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893189.251311:0:14439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787893189.251716:0:14439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4bb28 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.251725:0:14439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4bb28 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.251732:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4bb28 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.251748:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f47200 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893189.251779:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4bb28 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.251787:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4bb28 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.251801:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff907102b84200) 00010000:00010000:2.0:1787893189.251804:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893189.251809:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4bb28 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.251815:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4bb28 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.251831:0:14439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bb2f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.251836:0:14439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bb2f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.251842:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bb2f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.251847:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9ee00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893189.251850:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bb2f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.251856:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bb2f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.251874:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff907105cff400) 00010000:00010000:2.0:1787893189.251876:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893189.251879:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bb2f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.251885:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bb2f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.252361:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46400/0x825e3f5022b4bb21 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b362 expref: 10 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.252378:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f000/0x825e3f5022b4bb36 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b362 expref: 9 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.252387:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff907105cff700) 00010000:00010000:2.0:1787893189.252389:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893189.252392:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9f000, rc 0) 00000100:00100000:2.0:1787893189.254361:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f565180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bf598c2-503d-4eab-8bcc-148652504c30+9:14436:x1874741431487232:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 Request processed in 17135us (17601us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787893189.254382:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 16 00000100:00100000:2.0:1787893189.278910:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893189.279163:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431487360 00000100:00100000:3.0:1787893189.279176:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431487360 00000100:00100000:3.0:1787893189.279256:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 17 00000100:00100000:3.0:1787893189.279268:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f535880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bf598c2-503d-4eab-8bcc-148652504c30+9:14436:x1874741431487360:12345-192.168.202.29@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787893189.279422:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f535880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bf598c2-503d-4eab-8bcc-148652504c30+9:14436:x1874741431487360:12345-192.168.202.29@tcp:59:lhsmtool_posix.0 Request processed in 154us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893189.279430:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 17 00000100:00100000:0.0:1787893189.356840:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893189.357255:0:15611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431487488 00000100:00100000:1.0:1787893189.357271:0:15611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431487488 00000100:00100000:1.0:1787893189.357352:0:15611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 18 00000100:00100000:1.0:1787893189.357365:0:15611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0bf598c2-503d-4eab-8bcc-148652504c30+9:14442:x1874741431487488:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:1.0:1787893189.357395:0:15611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893189.357427:0:15611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071421faa00/0x825e3f5022b4bb44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b369 expref: -99 pid: 15611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.357531:0:15611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fae00/0x825e3f5022b4bb4b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.357548:0:15611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fae00/0x825e3f5022b4bb4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.357561:0:15611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fae00/0x825e3f5022b4bb4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.357577:0:15611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4bb52 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.357584:0:15611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4bb52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.357589:0:15611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4bb52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.357940:0:15611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fae00/0x825e3f5022b4bb4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.357949:0:15611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fae00/0x825e3f5022b4bb4b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.357964:0:15611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fae00/0x825e3f5022b4bb4b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.357970:0:15611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fae00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893189.358208:0:15611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fae00/0x825e3f5022b4bb4b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.358217:0:15611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fae00/0x825e3f5022b4bb4b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.358232:0:15611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9071061f7700) 00010000:00010000:1.0:1787893189.358235:0:15611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893189.358240:0:15611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fae00/0x825e3f5022b4bb4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.358247:0:15611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fae00/0x825e3f5022b4bb4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.358263:0:15611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4bb52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.358269:0:15611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4bb52 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.358275:0:15611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4bb52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.358279:0:15611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fa000 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893189.358281:0:15611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4bb52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.358298:0:15611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4bb52 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.358307:0:15611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff907104d8e200) 00010000:00010000:1.0:1787893189.358309:0:15611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893189.358311:0:15611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4bb52 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.358316:0:15611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa000/0x825e3f5022b4bb52 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.358357:0:15611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421faa00/0x825e3f5022b4bb44 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b369 expref: 10 pid: 15611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.358368:0:15611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9071061f7700) 00010000:00010000:1.0:1787893189.358371:0:15611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893189.358374:0:15611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421faa00/0x825e3f5022b4bb44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b369 expref: 10 pid: 15611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.358384:0:15611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071421faa00, rc 0) 00000100:00100000:1.0:1787893189.358485:0:15611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0bf598c2-503d-4eab-8bcc-148652504c30+9:14442:x1874741431487488:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 1121us (1662us total) trans 0 rc 301/301 00000100:00100000:1.0:1787893189.358494:0:15611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 18 00000100:00100000:1.0:1787893189.369906:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893189.370310:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431487616 00000100:00100000:2.0:1787893189.370326:0:14446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431487616 00000100:00100000:2.0:1787893189.370409:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 0 00000100:00100000:2.0:1787893189.370421:0:14446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f565f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0bf598c2-503d-4eab-8bcc-148652504c30+9:14442:x1874741431487616:12345-192.168.202.29@tcp:700:lfs.0 00000100:00100000:2.0:1787893189.370529:0:14446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f565f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0bf598c2-503d-4eab-8bcc-148652504c30+9:14442:x1874741431487616:12345-192.168.202.29@tcp:700:lfs.0 Request processed in 110us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893189.370558:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 0 00000100:00100000:0.0:1787893189.378477:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893189.378654:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431487872 00000100:00100000:3.0:1787893189.378668:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431487872 00000100:00100000:3.0:1787893189.378798:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 19 00000100:00100000:3.0:1787893189.378812:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bf598c2-503d-4eab-8bcc-148652504c30+9:14442:x1874741431487872:12345-192.168.202.29@tcp:36:lfs.0 00010000:00010000:3.0:1787893189.378894:0:14438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893189.378931:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4ba87 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b2e4 expref: 9 pid: 15611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.378955:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9071061f7700) 00010000:00010000:3.0:1787893189.378961:0:14438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787893189.379331:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bb59 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.379351:0:14438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4babf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b346 expref: 5 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.379362:0:14438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bb59 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.379412:0:14438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4babf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b346 expref: 5 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.379431:0:14438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4babf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b346 expref: 5 pid: 14438 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893189.379451:0:14438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14438:1874741455597184:192.168.202.29@tcp:104: 00000100:00100000:3.0:1787893189.379604:0:14438:0:(client.c:2715:ptlrpc_set_wait()) set ffff907105efa840 going to sleep for 11 seconds 00000100:00100000:3.0:1787893189.383293:0:14438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14438:1874741455597184:192.168.202.29@tcp:104: 00010000:00010000:3.0:1787893189.383340:0:14438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bb59 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893189.383583:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893189.383822:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431488000 00000100:00100000:1.0:1787893189.383835:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431488000 00010000:00010000:1.0:1787893189.383894:0:14424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4babf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b346 expref: 6 pid: 14438 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893189.383963:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 9 00000100:00100000:1.0:1787893189.383983:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:002066d6-fa17-4c0c-81b6-8973035fb81a+6:2360:x1874741431488000:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893189.384007:0:14424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893189.384025:0:14424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4babf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b346 expref: 6 pid: 14438 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.384038:0:14424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4babf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b346 expref: 6 pid: 14438 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.384072:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4babf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b346 expref: 6 pid: 14438 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.384095:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9071061f7700) 00010000:00010000:1.0:1787893189.384101:0:14424:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bb59 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.384114:0:14424:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bb59 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.384122:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bb59 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.384152:0:14424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893189.384229:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:002066d6-fa17-4c0c-81b6-8973035fb81a+5:2360:x1874741431488000:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 256us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893189.384237:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 9 00010000:00010000:3.0:1787893189.385035:0:14438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bb59 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.385050:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bb59 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.385086:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46800/0x825e3f5022b4bb60 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.385098:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46800/0x825e3f5022b4bb60 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.385107:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46800/0x825e3f5022b4bb60 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893189.389024:0:14438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787893189.389054:0:14438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bb59 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.389069:0:14438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bb59 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.389078:0:14438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bb59 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.389086:0:14438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f46200 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893189.389091:0:14438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bb59 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.389101:0:14438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bb59 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.389138:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9071061f7700) 00010000:00010000:3.0:1787893189.389141:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893189.389147:0:14438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bb59 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.389154:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bb59 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787893189.389180:0:14438:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b213a790 reply state 000000008f8d1daa transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46800/0x825e3f5022b4bb60 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893189.389191:0:14438:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787893189.389337:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bf598c2-503d-4eab-8bcc-148652504c30+10:14442:x1874741431487872:12345-192.168.202.29@tcp:36:lfs.0 Request processed in 10522us (10870us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787893189.389348:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 19 00010000:00010000:1.0:1787893189.398708:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46800/0x825e3f5022b4bb60 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.400669:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46800/0x825e3f5022b4bb60 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.400694:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46800/0x825e3f5022b4bb60 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.400703:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f46800 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893189.400709:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46800/0x825e3f5022b4bb60 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.400721:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46800/0x825e3f5022b4bb60 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.400747:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff907102b84800) 00010000:00010000:1.0:1787893189.401687:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787893189.401698:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46800/0x825e3f5022b4bb60 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.401707:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46800/0x825e3f5022b4bb60 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893189.521183:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893189.523928:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431488128 00000100:00100000:2.0:1787893189.523951:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431488128 00000100:00100000:2.0:1787893189.524065:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 20 00000100:00100000:2.0:1787893189.524077:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bf598c2-503d-4eab-8bcc-148652504c30+9:14450:x1874741431488128:12345-192.168.202.29@tcp:101:lctl.0 00010000:00010000:2.0:1787893189.524108:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893189.524139:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bb67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b370 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.524235:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fa00/0x825e3f5022b4bb6e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.524251:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fa00/0x825e3f5022b4bb6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.524264:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fa00/0x825e3f5022b4bb6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893189.524346:0:14439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787893189.524350:0:14439:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1787893189.524406:0:14439:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fa00/0x825e3f5022b4bb6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.524437:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bb67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b370 expref: 11 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.524462:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fa00/0x825e3f5022b4bb6e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b370 expref: 10 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.524495:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907105cff400) 00010000:00010000:2.0:1787893189.524498:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787893189.524514:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9fa00, rc 0) 00000100:00100000:2.0:1787893189.524623:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bf598c2-503d-4eab-8bcc-148652504c30+10:14450:x1874741431488128:12345-192.168.202.29@tcp:101:lctl.0 Request processed in 547us (3456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893189.524631:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 20 00000100:00100000:0.0:1787893189.576368:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893189.576559:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431488256 00000100:00100000:3.0:1787893189.576573:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431488256 00000100:00100000:3.0:1787893189.576664:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 21 00000100:00100000:3.0:1787893189.576677:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:002066d6-fa17-4c0c-81b6-8973035fb81a+5:14451:x1874741431488256:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:3.0:1787893189.576706:0:14437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893189.577290:0:14437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bb75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b377 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.577389:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46a00/0x825e3f5022b4bb7c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.577407:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46a00/0x825e3f5022b4bb7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.577440:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46a00/0x825e3f5022b4bb7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893189.577794:0:14437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787893189.577799:0:14437:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1787893189.577938:0:14437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46a00/0x825e3f5022b4bb7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.577975:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bb75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b377 expref: 7 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.577997:0:14437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46a00/0x825e3f5022b4bb7c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b377 expref: 6 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.578020:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907105cff400) 00010000:00010000:3.0:1787893189.578024:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787893189.578028:0:14437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907104f46a00, rc 0) 00000100:00100000:3.0:1787893189.578167:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:002066d6-fa17-4c0c-81b6-8973035fb81a+6:14451:x1874741431488256:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 1491us (1814us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893189.578184:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 21 00000100:00100000:0.0:1787893189.588306:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893189.588463:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431488384 00000100:00100000:2.0:1787893189.588475:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431488384 00000100:00100000:2.0:1787893189.588559:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 22 00000100:00100000:2.0:1787893189.588571:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:002066d6-fa17-4c0c-81b6-8973035fb81a+6:14451:x1874741431488384:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:2.0:1787893189.588598:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893189.588624:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bb83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b37e expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.588701:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4bb8a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.588716:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4bb8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.588738:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4bb8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.588786:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4bb91 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.588794:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4bb91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.588822:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4bb91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.588951:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4bb98 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.588960:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4bb98 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.588967:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4bb98 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893189.589295:0:14439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787893189.589299:0:14439:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787893189.589330:0:14439:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4bb98 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.589344:0:14439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4bb8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.589351:0:14439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4bb8a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.589358:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4bb8a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.589365:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9fc00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893189.589370:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4bb8a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.589377:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4bb8a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.589397:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907105cff400) 00010000:00010000:2.0:1787893189.589400:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893189.589405:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4bb8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.589412:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4bb8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.589428:0:14439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4bb91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.589433:0:14439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4bb91 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.589439:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4bb91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.589445:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9f600 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893189.589448:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4bb91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.589454:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4bb91 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.589460:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff907105cff500) 00010000:00010000:2.0:1787893189.589462:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893189.589464:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4bb91 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.589469:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4bb91 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.589565:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bb83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b37e expref: 8 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.589581:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4bb98 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b37e expref: 7 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.589590:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff907105cff800) 00010000:00010000:2.0:1787893189.589592:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787893189.589594:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9f400, rc 0) 00000100:00100000:2.0:1787893189.589675:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:002066d6-fa17-4c0c-81b6-8973035fb81a+7:14451:x1874741431488384:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 1107us (1382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893189.589683:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 22 00000100:00100000:0.0:1787893189.601935:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893189.602703:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431488640 00000100:00100000:3.0:1787893189.602719:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431488640 00000100:00100000:3.0:1787893189.602854:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 23 00000100:00100000:3.0:1787893189.602873:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:002066d6-fa17-4c0c-81b6-8973035fb81a+7:14451:x1874741431488640:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:3.0:1787893189.602902:0:14438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893189.602931:0:14438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bb9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b385 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893189.604805:0:14438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787893189.605333:0:14438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bb9f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b385 expref: 9 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.605356:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907105cff400) 00010000:00010000:3.0:1787893189.605359:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787893189.605365:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bb9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b385 expref: 9 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.605385:0:14438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907104f46200, rc 0) 00000100:00100000:3.0:1787893189.605494:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:002066d6-fa17-4c0c-81b6-8973035fb81a+8:14451:x1874741431488640:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 2628us (3574us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1787893189.609743:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 23 00000100:00100000:0.0:1787893189.611235:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893189.611406:0:15611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431488896 00000100:00100000:1.0:1787893189.611421:0:15611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431488896 00000100:00100000:1.0:1787893189.611509:0:15611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 24 00000100:00100000:1.0:1787893189.611522:0:15611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:002066d6-fa17-4c0c-81b6-8973035fb81a+8:14451:x1874741431488896:12345-192.168.202.29@tcp:36:lfs.0 00010000:00010000:1.0:1787893189.611605:0:15611:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893189.611641:0:15611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4bb98 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b37e expref: 8 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.611689:0:15611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff907105cff800) 00010000:00010000:1.0:1787893189.611704:0:15611:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787893189.611735:0:15611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4bbad lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.611748:0:15611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4bbad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.611805:0:15611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4bbad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787893189.613765:0:15611:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006851e049 reply state 0000000088c3721d transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4bbad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893189.613783:0:15611:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787893189.613811:0:15611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:1.0:1787893189.613914:0:15611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:002066d6-fa17-4c0c-81b6-8973035fb81a+9:14451:x1874741431488896:12345-192.168.202.29@tcp:36:lfs.0 Request processed in 2390us (2687us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787893189.613922:0:15611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 24 00010000:00010000:2.0:1787893189.630794:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4bbad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.630820:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4bbad lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.630829:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4bbad lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.630836:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fa400 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893189.630841:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4bbad lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.630850:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4bbad lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.630880:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff907104d8e200) 00010000:00010000:2.0:1787893189.630902:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1787893189.630909:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4bbad lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.630916:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4bbad lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893189.633521:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893189.641626:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431489152 00000100:00100000:1.0:1787893189.641662:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431489152 00000100:00100000:1.0:1787893189.641779:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 2 00000100:00100000:1.0:1787893189.641792:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f537100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:002066d6-fa17-4c0c-81b6-8973035fb81a+8:14451:x1874741431489152:12345-192.168.202.29@tcp:35:lfs.0 00000100:00100000:1.0:1787893189.642193:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f537100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:002066d6-fa17-4c0c-81b6-8973035fb81a+9:14451:x1874741431489152:12345-192.168.202.29@tcp:35:lfs.0 Request processed in 401us (8690us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1787893189.642203:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 2 00000100:00100000:0.0:1787893189.651403:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893189.651691:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431489408 00000100:00100000:3.0:1787893189.651705:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431489408 00000100:00100000:3.0:1787893189.651828:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 25 00000100:00100000:3.0:1787893189.651842:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:002066d6-fa17-4c0c-81b6-8973035fb81a+9:14451:x1874741431489408:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:3.0:1787893189.651878:0:14437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893189.651906:0:14437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bbb4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b38c expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.652282:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4bbbb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.652301:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4bbbb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.652337:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4bbbb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.652357:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4bbc2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.652364:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4bbc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.652372:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4bbc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893189.652580:0:14437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787893189.653069:0:14437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4bbbb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.653081:0:14437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4bbbb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.653089:0:14437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4bbbb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.653096:0:14437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f47c00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893189.653102:0:14437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4bbbb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.653111:0:14437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4bbbb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.653130:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907105cff400) 00010000:00010000:2.0:1787893189.653133:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893189.653140:0:14437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4bbbb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.653147:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4bbbb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.653165:0:14437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4bbc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.653182:0:14437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4bbc2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.653189:0:14437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4bbc2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.653193:0:14437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f47600 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893189.653197:0:14437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4bbc2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.653203:0:14437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4bbc2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.653210:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff907102b84b00) 00010000:00010000:2.0:1787893189.653213:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893189.653216:0:14437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4bbc2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.653221:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4bbc2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.653274:0:14437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bbb4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b38c expref: 11 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.653285:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907105cff400) 00010000:00010000:2.0:1787893189.653288:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787893189.653291:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bbb4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b38c expref: 11 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.653312:0:14437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907104f46200, rc 0) 00000100:00100000:2.0:1787893189.653407:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:002066d6-fa17-4c0c-81b6-8973035fb81a+10:14451:x1874741431489408:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 1567us (2018us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1787893189.653417:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 25 00000100:00100000:2.0:1787893189.671675:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893189.671811:0:15611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431489536 00000100:00100000:1.0:1787893189.671845:0:15611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431489536 00000100:00100000:1.0:1787893189.671940:0:15611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 26 00000100:00100000:1.0:1787893189.671953:0:15611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f534000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:002066d6-fa17-4c0c-81b6-8973035fb81a+10:14451:x1874741431489536:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:1.0:1787893189.672001:0:15611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893189.672046:0:15611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4bbd0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b393 expref: -99 pid: 15611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.672188:0:15611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4bbd7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.672206:0:15611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4bbd7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.672223:0:15611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4bbd7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893189.672306:0:15611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787893189.672311:0:15611:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787893189.672341:0:15611:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4bbd7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.672378:0:15611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb600/0x825e3f5022b4bbd0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b393 expref: 12 pid: 15611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.672408:0:15611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4bbd7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b393 expref: 11 pid: 15611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.672419:0:15611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff907104d8ef00) 00010000:00010000:1.0:1787893189.672422:0:15611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787893189.672428:0:15611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071421fa400, rc 0) 00000100:00100000:1.0:1787893189.672534:0:15611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f534000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:002066d6-fa17-4c0c-81b6-8973035fb81a+11:14451:x1874741431489536:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 581us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893189.672542:0:15611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 26 00000100:00100000:0.0:1787893189.678278:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893189.678385:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431489664 00000100:00100000:1.0:1787893189.678402:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431489664 00000100:00100000:1.0:1787893189.678494:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 3 00000100:00100000:1.0:1787893189.678506:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:002066d6-fa17-4c0c-81b6-8973035fb81a+11:14451:x1874741431489664:12345-192.168.202.29@tcp:37:lfs.0 00000100:00100000:1.0:1787893189.688001:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:002066d6-fa17-4c0c-81b6-8973035fb81a+11:14451:x1874741431489664:12345-192.168.202.29@tcp:37:lfs.0 Request processed in 9463us (9708us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893189.688031:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 3 00000100:00100000:2.0:1787893189.710022:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893189.710165:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431489920 00000100:00100000:3.0:1787893189.710179:0:14440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431489920 00000100:00100000:3.0:1787893189.710260:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 4 00000100:00100000:3.0:1787893189.710274:0:14440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907110d9dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:002066d6-fa17-4c0c-81b6-8973035fb81a+11:14451:x1874741431489920:12345-192.168.202.29@tcp:35:lfs.0 00000100:00100000:3.0:1787893189.710683:0:14440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907110d9dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:002066d6-fa17-4c0c-81b6-8973035fb81a+12:14451:x1874741431489920:12345-192.168.202.29@tcp:35:lfs.0 Request processed in 410us (693us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1787893189.710692:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 4 00000100:00100000:0.0:1787893189.769039:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893189.769202:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431490048 00000100:00100000:3.0:1787893189.769216:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431490048 00000100:00100000:3.0:1787893189.769298:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 27 00000100:00100000:3.0:1787893189.769310:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bf598c2-503d-4eab-8bcc-148652504c30+10:14457:x1874741431490048:12345-192.168.202.29@tcp:101:bash.0 00010000:00010000:3.0:1787893189.769338:0:14438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893189.769366:0:14438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4bbde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b39a expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.769475:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4bbe5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.769491:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4bbe5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.769517:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4bbe5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.769536:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bbec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.769544:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bbec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.769559:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bbec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.769965:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4bbf3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.769987:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4bbf3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.769994:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4bbf3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893189.770042:0:14438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1787893189.770046:0:14438:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787893189.770095:0:14438:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4bbf3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.770122:0:14438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4bbe5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.770129:0:14438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4bbe5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.770137:0:14438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4bbe5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.770144:0:14438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f47e00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893189.770150:0:14438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4bbe5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.770158:0:14438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4bbe5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.770172:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907105cff400) 00010000:00010000:3.0:1787893189.770175:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893189.770180:0:14438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4bbe5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.770186:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4bbe5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.770202:0:14438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bbec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.770209:0:14438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bbec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.770214:0:14438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bbec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.770225:0:14438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f46200 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893189.770228:0:14438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bbec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.770234:0:14438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bbec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.770241:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff907102b84b00) 00010000:00010000:3.0:1787893189.770244:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893189.770246:0:14438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bbec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.770251:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bbec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.770290:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4bbde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b39a expref: 12 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.770305:0:14438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47600/0x825e3f5022b4bbf3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b39a expref: 11 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.770312:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff907104d8ef00) 00010000:00010000:3.0:1787893189.770315:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787893189.770318:0:14438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907104f47600, rc 0) 00000100:00100000:3.0:1787893189.770408:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bf598c2-503d-4eab-8bcc-148652504c30+11:14457:x1874741431490048:12345-192.168.202.29@tcp:101:bash.0 Request processed in 1099us (1387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893189.770416:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 27 00000100:00100000:0.0:1787893189.774576:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893189.774806:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431490304 00000100:00100000:3.0:1787893189.774846:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431490304 00000100:00100000:3.0:1787893189.774928:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 28 00000100:00100000:3.0:1787893189.774940:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105af9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bf598c2-503d-4eab-8bcc-148652504c30+11:14457:x1874741431490304:12345-192.168.202.29@tcp:101:bash.0 00010000:00010000:3.0:1787893189.774980:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893189.775018:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4bbfa lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b3a1 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.775195:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46800/0x825e3f5022b4bc01 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.775215:0:14439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4bbd7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b393 expref: 11 pid: 15611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.775225:0:14439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46800/0x825e3f5022b4bc01 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.775273:0:14439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4bbd7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b393 expref: 11 pid: 15611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.775289:0:14439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4bbd7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b393 expref: 11 pid: 15611 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893189.775305:0:14439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14439:1874741455597312:192.168.202.29@tcp:104: 00000100:00100000:3.0:1787893189.775422:0:14439:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071091329c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787893189.788471:0:14439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14439:1874741455597312:192.168.202.29@tcp:104: 00010000:00010000:3.0:1787893189.788526:0:14439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46800/0x825e3f5022b4bc01 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893189.788938:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893189.789439:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431490432 00000100:00100000:1.0:1787893189.789451:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431490432 00010000:00010000:1.0:1787893189.789509:0:14422:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4bbd7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b393 expref: 12 pid: 15611 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893189.789554:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 10 00000100:00100000:1.0:1787893189.789564:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105af8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:002066d6-fa17-4c0c-81b6-8973035fb81a+12:2360:x1874741431490432:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893189.789584:0:14422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893189.789592:0:14422:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4bbd7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b393 expref: 12 pid: 15611 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.789607:0:14422:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4bbd7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b393 expref: 12 pid: 15611 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.789634:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4bbd7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b393 expref: 12 pid: 15611 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.789678:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff907104d8ef00) 00010000:00010000:1.0:1787893189.789683:0:14422:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46800/0x825e3f5022b4bc01 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.789694:0:14422:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46800/0x825e3f5022b4bc01 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.789703:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46800/0x825e3f5022b4bc01 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.789733:0:14422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893189.789851:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105af8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:002066d6-fa17-4c0c-81b6-8973035fb81a+11:2360:x1874741431490432:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 287us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893189.789859:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 10 00010000:00010000:3.0:1787893189.790426:0:14439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46800/0x825e3f5022b4bc01 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.790437:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46800/0x825e3f5022b4bc01 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.790469:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4bc08 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.790480:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4bc08 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893189.790489:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4bc08 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.792399:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4bc0f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.792422:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4bc0f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.792436:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4bc0f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893189.792451:0:14439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787893189.792486:0:14439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46800/0x825e3f5022b4bc01 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.792494:0:14439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46800/0x825e3f5022b4bc01 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.799140:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46800/0x825e3f5022b4bc01 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.799151:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f46800 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893189.799156:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46800/0x825e3f5022b4bc01 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.799197:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46800/0x825e3f5022b4bc01 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.799224:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff907104d8ef00) 00010000:00010000:2.0:1787893189.799228:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893189.799235:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46800/0x825e3f5022b4bc01 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.799243:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46800/0x825e3f5022b4bc01 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787893189.799273:0:14439:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000319bd440 reply state 0000000041c03b2a transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4bc08 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893189.799285:0:14439:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787893189.799368:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47c00/0x825e3f5022b4bbfa lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3a1 expref: 14 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.799386:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4bc0f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3a1 expref: 13 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.799393:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff907105cff500) 00010000:00010000:2.0:1787893189.799396:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1787893189.799398:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9ec00, rc 0) 00000100:00100000:2.0:1787893189.799515:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105af9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bf598c2-503d-4eab-8bcc-148652504c30+14:14457:x1874741431490304:12345-192.168.202.29@tcp:101:bash.0 Request processed in 24576us (24961us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787893189.799525:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 28 00010000:00010000:2.0:1787893189.810420:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4bc08 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.810474:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4bc08 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.810484:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4bc08 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.810491:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f46000 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893189.810498:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4bc08 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.810508:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4bc08 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.810537:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff907102b84b00) 00010000:00010000:2.0:1787893189.810540:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893189.810547:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4bc08 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893189.810565:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46000/0x825e3f5022b4bc08 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893189.821434:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893189.821499:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431490560 00000100:00100000:2.0:1787893189.821514:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431490560 00000100:00100000:2.0:1787893189.821616:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 29 00000100:00100000:2.0:1787893189.821631:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bf598c2-503d-4eab-8bcc-148652504c30+13:14457:x1874741431490560:12345-192.168.202.29@tcp:101:bash.0 00010000:00010000:2.0:1787893189.821672:0:14437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893189.821714:0:14437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4bc1d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b3a8 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.826021:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4bc24 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.826054:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4bc24 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.826068:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4bc24 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893189.826128:0:14437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787893189.826133:0:14437:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787893189.826163:0:14437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4bc24 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.826176:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4bc24 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.826244:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4bc1d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3a8 expref: 15 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.826270:0:14437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4bc24 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3a8 expref: 14 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.826279:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff907105cff500) 00010000:00010000:1.0:1787893189.826282:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787893189.826287:0:14437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071421fa400, rc 0) 00000100:00100000:1.0:1787893189.826392:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bf598c2-503d-4eab-8bcc-148652504c30+14:14457:x1874741431490560:12345-192.168.202.29@tcp:101:bash.0 Request processed in 4764us (4976us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893189.826402:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 29 00000100:00100000:1.0:1787893189.829402:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893189.829480:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431490816 00000100:00100000:3.0:1787893189.829493:0:14440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431490816 00000100:00100000:3.0:1787893189.829568:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 5 00000100:00100000:3.0:1787893189.829580:0:14440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f566300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0bf598c2-503d-4eab-8bcc-148652504c30+14:14457:x1874741431490816:12345-192.168.202.29@tcp:35:bash.0 00000100:00100000:3.0:1787893189.830137:0:14440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f566300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0bf598c2-503d-4eab-8bcc-148652504c30+15:14457:x1874741431490816:12345-192.168.202.29@tcp:35:bash.0 Request processed in 556us (747us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1787893189.830146:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 5 00010000:00010000:1.0:1787893189.899189:0:16140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893189.942209:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893189.942334:0:15611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431491072 00000100:00100000:1.0:1787893189.942346:0:15611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431491072 00000100:00100000:1.0:1787893189.942415:0:15611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 30 00000100:00100000:1.0:1787893189.942429:0:15611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0bf598c2-503d-4eab-8bcc-148652504c30+15:14467:x1874741431491072:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:1.0:1787893189.942465:0:15611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893189.942492:0:15611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4bc2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b3af expref: -99 pid: 15611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893189.942655:0:15611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787893189.942867:0:15611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4bc2b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3af expref: 17 pid: 15611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.942904:0:15611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907105cff400) 00010000:00010000:1.0:1787893189.942908:0:15611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787893189.942914:0:15611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4bc2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3af expref: 17 pid: 15611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.942935:0:15611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071421fb400, rc 0) 00000100:00100000:1.0:1787893189.943039:0:15611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0bf598c2-503d-4eab-8bcc-148652504c30+16:14467:x1874741431491072:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 611us (844us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1787893189.943047:0:15611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 30 00000100:00100000:0.0:1787893189.951189:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893189.951627:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431491328 00000100:00100000:3.0:1787893189.951684:0:14440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431491328 00000100:00100000:3.0:1787893189.951877:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 6 00000100:00100000:3.0:1787893189.951891:0:14440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105af8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0bf598c2-503d-4eab-8bcc-148652504c30+16:14467:x1874741431491328:12345-192.168.202.29@tcp:35:lfs.0 00000100:00100000:3.0:1787893189.952486:0:14440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105af8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0bf598c2-503d-4eab-8bcc-148652504c30+17:14467:x1874741431491328:12345-192.168.202.29@tcp:35:lfs.0 Request processed in 595us (1310us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1787893189.952505:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 6 00000100:00100000:2.0:1787893189.988689:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893189.989157:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431491584 00000100:00100000:1.0:1787893189.989171:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431491584 00000100:00100000:1.0:1787893189.989245:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 31 00000100:00100000:1.0:1787893189.989254:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f537480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bf598c2-503d-4eab-8bcc-148652504c30+17:14470:x1874741431491584:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:1.0:1787893189.989287:0:14438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893189.989316:0:14438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4bc39 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b3b6 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.989438:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fae00/0x825e3f5022b4bc40 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.989452:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fae00/0x825e3f5022b4bc40 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.989463:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fae00/0x825e3f5022b4bc40 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787893189.989474:0:14438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787893189.990044:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb400/0x825e3f5022b4bc39 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3b6 expref: 20 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.990072:0:14438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fae00/0x825e3f5022b4bc40 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3b6 expref: 19 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.990082:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff907105cff500) 00010000:00010000:1.0:1787893189.990085:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787893189.990089:0:14438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071421fae00, rc 0) 00000100:00100000:1.0:1787893189.990161:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f537480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bf598c2-503d-4eab-8bcc-148652504c30+19:14470:x1874741431491584:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 906us (1485us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1787893189.990169:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 31 00000100:00100000:3.0:1787893189.993283:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893189.993346:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893189.993525:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431491712 00000100:00100000:0.0:1787893189.993539:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431491712 00000100:00100000:0.0:1787893189.993617:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 32 00000100:00100000:0.0:1787893189.993629:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bf598c2-503d-4eab-8bcc-148652504c30+19:14470:x1874741431491712:12345-192.168.202.29@tcp:54:lfs.0 00010000:00010000:0.0:1787893189.993724:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4bc4e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893189.993794:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4bc4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893189.993809:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4bc4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893189.993859:0:14439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4bc4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893189.993867:0:14439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4bc4e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893189.993875:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4bc4e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893189.993882:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc9a00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:0.0:1787893189.993887:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4bc4e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893189.993895:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4bc4e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893189.993910:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff907105cff500) 00010000:00010000:0.0:1787893189.993914:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787893189.993921:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4bc4e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893189.993928:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4bc4e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893189.994182:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bf598c2-503d-4eab-8bcc-148652504c30+19:14470:x1874741431491712:12345-192.168.202.29@tcp:54:lfs.0 Request processed in 554us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893189.994198:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 32 00000100:00100000:1.0:1787893189.995240:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431491840 00000100:00100000:1.0:1787893189.995254:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431491840 00000100:00100000:1.0:1787893189.995330:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 0 00000100:00100000:1.0:1787893189.995343:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0bf598c2-503d-4eab-8bcc-148652504c30+19:2360:x1874741431491840:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893189.995361:0:14423:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893189.995387:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fae00/0x825e3f5022b4bc40 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3b6 expref: 19 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893189.995410:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff907105cff500) 00010000:00010000:1.0:1787893189.995415:0:14423:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893189.995471:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0bf598c2-503d-4eab-8bcc-148652504c30+18:2360:x1874741431491840:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 131us (2125us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893189.995478:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 0 00000100:00100000:3.0:1787893189.999233:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893189.999318:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431492096 00000100:00100000:1.0:1787893189.999336:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431492096 00000100:00100000:1.0:1787893189.999516:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 7 00000100:00100000:1.0:1787893189.999530:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0bf598c2-503d-4eab-8bcc-148652504c30+18:14470:x1874741431492096:12345-192.168.202.29@tcp:35:lfs.0 00000100:00100000:1.0:1787893189.999910:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0bf598c2-503d-4eab-8bcc-148652504c30+19:14470:x1874741431492096:12345-192.168.202.29@tcp:35:lfs.0 Request processed in 381us (687us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1787893189.999920:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 7 00000040:00080000:1.0:1787893190.284358:0:14469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787893190.369496:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893190.370776:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431492352 00000100:00100000:2.0:1787893190.370788:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431492352 00000100:00080000:2.0:1787893190.370813:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787893190.370857:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 33 00000100:00100000:2.0:1787893190.370867:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105afb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bf598c2-503d-4eab-8bcc-148652504c30+19:14501:x1874741431492352:12345-192.168.202.29@tcp:101:cat.0 00010000:00010000:2.0:1787893190.372045:0:14437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893190.372074:0:14437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4bc55 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b3bd expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893190.372372:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bc5c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893190.372387:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bc5c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893190.372403:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bc5c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893190.372414:0:14437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787893190.372585:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4bc55 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3bd expref: 22 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893190.372603:0:14437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bc5c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3bd expref: 21 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893190.372611:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff907105cff500) 00010000:00010000:2.0:1787893190.372625:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787893190.372629:0:14437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9ee00, rc 0) 00000100:00100000:2.0:1787893190.372709:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105afb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bf598c2-503d-4eab-8bcc-148652504c30+21:14501:x1874741431492352:12345-192.168.202.29@tcp:101:cat.0 Request processed in 1841us (3223us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1787893190.372718:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 33 00000100:00100000:2.0:1787893190.376635:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893190.376684:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893190.377788:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431492736 00000100:00100000:1.0:1787893190.377800:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431492736 00000100:00100000:1.0:1787893190.377880:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 1 00000100:00100000:1.0:1787893190.377890:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f534700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0bf598c2-503d-4eab-8bcc-148652504c30+21:2362:x1874741431492736:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787893190.377904:0:14424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893190.377928:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bc5c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3bd expref: 21 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893190.377946:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff907105cff500) 00010000:00010000:1.0:1787893190.377950:0:14424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787893190.378023:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f534700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0bf598c2-503d-4eab-8bcc-148652504c30+20:2362:x1874741431492736:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 133us (1337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893190.378030:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 1 00000100:00100000:3.0:1787893190.378658:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431492608 00000100:00100000:3.0:1787893190.378665:0:14440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431492608 00000100:00100000:3.0:1787893190.378705:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 8 00000100:00100000:3.0:1787893190.378713:0:14440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0bf598c2-503d-4eab-8bcc-148652504c30+20:14501:x1874741431492608:12345-192.168.202.29@tcp:35:cat.0 00000100:00100000:3.0:1787893190.379065:0:14440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0bf598c2-503d-4eab-8bcc-148652504c30+21:14501:x1874741431492608:12345-192.168.202.29@tcp:35:cat.0 Request processed in 352us (2439us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1787893190.379073:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 8 00000001:00080000:0.0:1787893190.414332:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934605 is committed 00000001:00080000:0.0:1787893190.414355:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:0.0:1787893190.414376:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1787893190.522283:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893190.522589:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431492992 00000100:00100000:0.0:1787893190.522598:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431492992 00000100:00100000:0.0:1787893190.522697:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 34 00000100:00100000:0.0:1787893190.522708:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f537800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bf598c2-503d-4eab-8bcc-148652504c30+13:14507:x1874741431492992:12345-192.168.202.29@tcp:101:dd.0 00010000:00010000:0.0:1787893190.522736:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893190.522799:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4bc6a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b3c4 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893190.522897:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8a00/0x825e3f5022b4bc71 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893190.522911:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8a00/0x825e3f5022b4bc71 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893190.522922:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8a00/0x825e3f5022b4bc71 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893190.522932:0:14439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787893190.524230:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4bc6a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3c4 expref: 16 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893190.524257:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8a00/0x825e3f5022b4bc71 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3c4 expref: 15 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893190.524288:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff907105cff500) 00010000:00010000:0.0:1787893190.524291:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787893190.524295:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907137fc8a00, rc 0) 00000100:00100000:0.0:1787893190.524360:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f537800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bf598c2-503d-4eab-8bcc-148652504c30+15:14507:x1874741431492992:12345-192.168.202.29@tcp:101:dd.0 Request processed in 1653us (2089us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1787893190.524367:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 34 00000100:00100000:3.0:1787893190.529902:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893190.530223:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431493248 00000100:00100000:1.0:1787893190.530233:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431493248 00000100:00100000:1.0:1787893190.530289:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 35 00000100:00100000:1.0:1787893190.530298:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bf598c2-503d-4eab-8bcc-148652504c30+15:14507:x1874741431493248:12345-192.168.202.29@tcp:36:dd.0 00010000:00010000:1.0:1787893190.530357:0:14438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787893190.530384:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8a00/0x825e3f5022b4bc71 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3c4 expref: 15 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893190.530424:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4bc24 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3a8 expref: 14 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893190.530437:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff907105cff500) 00010000:00010000:1.0:1787893190.530441:0:14438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787893190.530660:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421faa00/0x825e3f5022b4bc7f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893190.530673:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071421faa00/0x825e3f5022b4bc7f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893190.530682:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071421faa00/0x825e3f5022b4bc7f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787893190.530728:0:14438:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1787893190.530797:0:14438:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d0a637fc reply state 00000000984d8ea1 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9071421faa00/0x825e3f5022b4bc7f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893190.530806:0:14438:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787893190.530912:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bf598c2-503d-4eab-8bcc-148652504c30+16:14507:x1874741431493248:12345-192.168.202.29@tcp:36:dd.0 Request processed in 614us (1020us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1787893190.530920:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 35 00000020:00080000:1.0:1787893190.530925:0:14438:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787893190.535335:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421faa00/0x825e3f5022b4bc7f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893190.535362:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071421faa00/0x825e3f5022b4bc7f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893190.535370:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071421faa00/0x825e3f5022b4bc7f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893190.535377:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421faa00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893190.535382:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071421faa00/0x825e3f5022b4bc7f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893190.535390:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071421faa00/0x825e3f5022b4bc7f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893190.535407:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff907105cff500) 00010000:00010000:2.0:1787893190.535410:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893190.535414:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071421faa00/0x825e3f5022b4bc7f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893190.535421:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421faa00/0x825e3f5022b4bc7f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893190.643906:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893190.645704:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431493504 00000100:00100000:0.0:1787893190.645722:0:14440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431493504 00000100:00100000:0.0:1787893190.645802:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 9 00000100:00100000:0.0:1787893190.645813:0:14440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0bf598c2-503d-4eab-8bcc-148652504c30+15:14507:x1874741431493504:12345-192.168.202.29@tcp:35:dd.0 00000100:00100000:0.0:1787893190.646187:0:14440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0bf598c2-503d-4eab-8bcc-148652504c30+16:14507:x1874741431493504:12345-192.168.202.29@tcp:35:dd.0 Request processed in 374us (2292us total) trans 8589934611 rc 0/0 00000100:00100000:0.0:1787893190.646196:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 9 00000100:00100000:2.0:1787893190.893720:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893190.893940:0:15611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431493632 00000100:00100000:3.0:1787893190.893951:0:15611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431493632 00000100:00100000:3.0:1787893190.894055:0:15611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 36 00000100:00100000:3.0:1787893190.894066:0:15611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f536680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0bf598c2-503d-4eab-8bcc-148652504c30+16:14521:x1874741431493632:12345-192.168.202.29@tcp:101:stat.0 00010000:00010000:3.0:1787893190.894106:0:15611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893190.894130:0:15611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bc86 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b3cb expref: -99 pid: 15611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893190.894276:0:15611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4bc8d lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893190.894295:0:15611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4bc8d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893190.894324:0:15611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4bc8d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893190.894339:0:15611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46400/0x825e3f5022b4bc94 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893190.894350:0:15611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46400/0x825e3f5022b4bc94 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893190.894357:0:15611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46400/0x825e3f5022b4bc94 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893190.894884:0:15611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4bc9b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893190.894895:0:15611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4bc9b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893190.894902:0:15611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4bc9b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787893190.894936:0:15611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787893190.894940:0:15611:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787893190.894977:0:15611:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4bc9b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893190.895017:0:15611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4bc9b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893190.895026:0:15611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4bc8d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893190.895042:0:15611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4bc8d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893190.895049:0:15611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4bc8d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893190.895055:0:15611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f47e00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893190.895059:0:15611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4bc8d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893190.895067:0:15611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4bc8d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893190.895080:0:15611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff907104d8ef00) 00010000:00010000:3.0:1787893190.895083:0:15611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893190.895087:0:15611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4bc8d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893190.895093:0:15611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47e00/0x825e3f5022b4bc8d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893190.895106:0:15611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46400/0x825e3f5022b4bc94 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893190.895113:0:15611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46400/0x825e3f5022b4bc94 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893190.895125:0:15611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46400/0x825e3f5022b4bc94 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893190.895131:0:15611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f46400 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893190.895139:0:15611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46400/0x825e3f5022b4bc94 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893190.895145:0:15611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46400/0x825e3f5022b4bc94 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893190.895332:0:15611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff907102b84000) 00010000:00010000:3.0:1787893190.895336:0:15611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893190.895340:0:15611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46400/0x825e3f5022b4bc94 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893190.895346:0:15611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46400/0x825e3f5022b4bc94 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893190.895389:0:15611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bc86 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3cb expref: 18 pid: 15611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893190.895404:0:15611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4bc9b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3cb expref: 17 pid: 15611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893190.895416:0:15611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff907105cff500) 00010000:00010000:3.0:1787893190.895419:0:15611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787893190.895421:0:15611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907104f47200, rc 0) 00000100:00100000:3.0:1787893190.895619:0:15611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f536680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0bf598c2-503d-4eab-8bcc-148652504c30+17:14521:x1874741431493632:12345-192.168.202.29@tcp:101:stat.0 Request processed in 1553us (1912us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893190.895627:0:15611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 36 00010000:00010000:0.0:1787893190.922308:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893191.009611:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893191.009728:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431493888 00000100:00100000:1.0:1787893191.009738:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431493888 00000100:00100000:1.0:1787893191.009855:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 37 00000100:00100000:1.0:1787893191.009872:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bf598c2-503d-4eab-8bcc-148652504c30+17:14527:x1874741431493888:12345-192.168.202.29@tcp:36:truncate.0 00010000:00010000:1.0:1787893191.009944:0:14438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787893191.009976:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f47200/0x825e3f5022b4bc9b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3cb expref: 17 pid: 15611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893191.010009:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff907105cff500) 00010000:00010000:1.0:1787893191.010014:0:14438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787893191.010510:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa600/0x825e3f5022b4bca2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893191.010526:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa600/0x825e3f5022b4bca2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893191.010537:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa600/0x825e3f5022b4bca2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787893191.010585:0:14438:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:1.0:1787893191.010607:0:14438:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000090c68664 reply state 00000000c1de3ab3 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa600/0x825e3f5022b4bca2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893191.010616:0:14438:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787893191.010806:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bf598c2-503d-4eab-8bcc-148652504c30+19:14527:x1874741431493888:12345-192.168.202.29@tcp:36:truncate.0 Request processed in 941us (1204us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1787893191.010814:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 37 00000020:00080000:1.0:1787893191.010819:0:14438:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787893191.017692:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa600/0x825e3f5022b4bca2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893191.017710:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa600/0x825e3f5022b4bca2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893191.017718:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa600/0x825e3f5022b4bca2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893191.017724:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fa600 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893191.017729:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa600/0x825e3f5022b4bca2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893191.017737:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa600/0x825e3f5022b4bca2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893191.017776:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff907105cff500) 00010000:00010000:2.0:1787893191.017780:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893191.017785:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa600/0x825e3f5022b4bca2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893191.017792:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa600/0x825e3f5022b4bca2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893191.265002:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893191.265129:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431494016 00000100:00100000:0.0:1787893191.265140:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431494016 00000100:00100000:0.0:1787893191.265193:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 38 00000100:00100000:0.0:1787893191.265205:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bf598c2-503d-4eab-8bcc-148652504c30+18:14542:x1874741431494016:12345-192.168.202.29@tcp:101:stat.0 00010000:00010000:0.0:1787893191.265228:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893191.265247:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4bca9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b3d2 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893191.265308:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8a00/0x825e3f5022b4bcb0 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893191.265321:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8a00/0x825e3f5022b4bcb0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893191.265346:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8a00/0x825e3f5022b4bcb0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893191.265361:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4bcb7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893191.265367:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4bcb7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893191.265374:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4bcb7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893191.265696:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4bcbe lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893191.265705:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4bcbe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893191.265712:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4bcbe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787893191.265745:0:14439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:0.0:1787893191.265749:0:14439:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787893191.265802:0:14439:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4bcbe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893191.265814:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4bcbe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893191.265823:0:14439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8a00/0x825e3f5022b4bcb0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893191.265838:0:14439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8a00/0x825e3f5022b4bcb0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893191.265845:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8a00/0x825e3f5022b4bcb0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893191.265851:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc8a00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:0.0:1787893191.265856:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8a00/0x825e3f5022b4bcb0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893191.265956:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8a00/0x825e3f5022b4bcb0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893191.265969:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff907104d8ef00) 00010000:00010000:0.0:1787893191.265972:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893191.265976:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8a00/0x825e3f5022b4bcb0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893191.265983:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8a00/0x825e3f5022b4bcb0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893191.266005:0:14439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4bcb7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893191.266011:0:14439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4bcb7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893191.266017:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4bcb7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893191.266022:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc8400 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:0.0:1787893191.266030:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4bcb7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893191.266036:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4bcb7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893191.266044:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9071061f7300) 00010000:00010000:0.0:1787893191.266047:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893191.266050:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4bcb7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893191.266055:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4bcb7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893191.266083:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4bca9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3d2 expref: 20 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893191.266096:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4bcbe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3d2 expref: 19 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893191.266103:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff907105cff500) 00010000:00010000:0.0:1787893191.266106:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787893191.266108:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907137fc9e00, rc 0) 00000100:00100000:0.0:1787893191.266166:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bf598c2-503d-4eab-8bcc-148652504c30+19:14542:x1874741431494016:12345-192.168.202.29@tcp:101:stat.0 Request processed in 963us (1184us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893191.266173:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 38 00000100:00100000:1.0:1787893191.333244:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893191.333344:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431494272 00000100:00100000:2.0:1787893191.333355:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431494272 00000100:00100000:2.0:1787893191.333456:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 39 00000100:00100000:2.0:1787893191.333468:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f565c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bf598c2-503d-4eab-8bcc-148652504c30+19:14552:x1874741431494272:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:2.0:1787893191.333503:0:14437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893191.333538:0:14437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4bcc5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b3d9 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893191.333853:0:14437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787893191.334068:0:14437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4bcc5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3d9 expref: 21 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893191.334084:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907105cff400) 00010000:00010000:2.0:1787893191.334087:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787893191.334093:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4bcc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3d9 expref: 21 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893191.334107:0:14437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9ea00, rc 0) 00000100:00100000:2.0:1787893191.334170:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f565c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bf598c2-503d-4eab-8bcc-148652504c30+20:14552:x1874741431494272:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 704us (937us total) trans 8589934614 rc 301/301 00000100:00100000:2.0:1787893191.334178:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 39 00000100:00100000:2.0:1787893191.339530:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893191.339616:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431494528 00000100:00100000:0.0:1787893191.339628:0:14440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431494528 00000100:00100000:0.0:1787893191.339957:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 10 00000100:00100000:0.0:1787893191.339969:0:14440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907110d9c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0bf598c2-503d-4eab-8bcc-148652504c30+20:14552:x1874741431494528:12345-192.168.202.29@tcp:35:lfs.0 00000100:00100000:0.0:1787893191.340455:0:14440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907110d9c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0bf598c2-503d-4eab-8bcc-148652504c30+21:14552:x1874741431494528:12345-192.168.202.29@tcp:35:lfs.0 Request processed in 486us (933us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1787893191.340463:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 10 00000100:00100000:3.0:1787893191.396536:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893191.396646:0:15611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431494784 00000100:00100000:1.0:1787893191.396656:0:15611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431494784 00000100:00100000:1.0:1787893191.396727:0:15611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 40 00000100:00100000:1.0:1787893191.396738:0:15611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0bf598c2-503d-4eab-8bcc-148652504c30+21:14558:x1874741431494784:12345-192.168.202.29@tcp:101:bash.0 00010000:00010000:1.0:1787893191.396800:0:15611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787893191.396821:0:15611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa800/0x825e3f5022b4bcd3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b3e0 expref: -99 pid: 15611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893191.396940:0:15611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb200/0x825e3f5022b4bcda lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893191.397612:0:15611:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4bc0f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3a1 expref: 22 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893191.397623:0:15611:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4bcbe lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3d2 expref: 22 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893191.397633:0:15611:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb200/0x825e3f5022b4bcda lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893191.397672:0:15611:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4bcbe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3d2 expref: 22 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893191.397687:0:15611:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4bcbe lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3d2 expref: 22 pid: 14439 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893191.397712:0:15611:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f564e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15611:1874741455597440:192.168.202.29@tcp:104: 00010000:00010000:1.0:1787893191.397845:0:15611:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4bc0f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3a1 expref: 22 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893191.397855:0:15611:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4bc0f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3a1 expref: 22 pid: 14439 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893191.397864:0:15611:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f566300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15611:1874741455597568:192.168.202.29@tcp:104: 00000100:00100000:1.0:1787893191.397899:0:15611:0:(client.c:2715:ptlrpc_set_wait()) set ffff907002c15000 going to sleep for 11 seconds 00000100:00100000:2.0:1787893191.403780:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893191.403907:0:15611:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f564e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15611:1874741455597440:192.168.202.29@tcp:104: 00000100:00100000:1.0:1787893191.403922:0:15611:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f566300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15611:1874741455597568:192.168.202.29@tcp:104: 00010000:00010000:1.0:1787893191.403949:0:15611:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb200/0x825e3f5022b4bcda lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893191.405201:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431494912 00000100:00100000:3.0:1787893191.405224:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431494912 00010000:00010000:3.0:1787893191.405268:0:14422:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4bcbe lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3d2 expref: 23 pid: 14439 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893191.405376:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 11 00000100:00100000:3.0:1787893191.405387:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f428450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0bf598c2-503d-4eab-8bcc-148652504c30+23:2360:x1874741431494912:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787893191.405403:0:14422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893191.405411:0:14422:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4bcbe lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3d2 expref: 23 pid: 14439 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893191.405426:0:14422:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4bcbe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3d2 expref: 23 pid: 14439 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893191.405451:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4bcbe lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3d2 expref: 23 pid: 14439 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893191.405468:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff907105cff500) 00010000:00010000:3.0:1787893191.405473:0:14422:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb200/0x825e3f5022b4bcda lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893191.405481:0:14422:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb200/0x825e3f5022b4bcda lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893191.405501:0:14422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893191.405563:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f428450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0bf598c2-503d-4eab-8bcc-148652504c30+22:2360:x1874741431494912:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 177us (1871us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893191.405571:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 11 00000100:00100000:2.0:1787893191.405685:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893191.410692:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431495040 00000100:00100000:0.0:1787893191.410718:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431495040 00010000:00010000:0.0:1787893191.410799:0:14424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4bc0f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3a1 expref: 22 pid: 14439 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893191.410839:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 12 00000100:00100000:0.0:1787893191.410850:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f534e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0bf598c2-503d-4eab-8bcc-148652504c30+22:2360:x1874741431495040:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893191.410869:0:14424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893191.410876:0:14424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4bc0f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3a1 expref: 22 pid: 14439 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893191.410891:0:14424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4bc0f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3a1 expref: 22 pid: 14439 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893191.410914:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4bc0f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3a1 expref: 22 pid: 14439 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893191.410931:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff907105cff500) 00010000:00010000:0.0:1787893191.410937:0:14424:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb200/0x825e3f5022b4bcda lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893191.410947:0:14424:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb200/0x825e3f5022b4bcda lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893191.410969:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb200/0x825e3f5022b4bcda lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893191.411023:0:14424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893191.411334:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f534e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0bf598c2-503d-4eab-8bcc-148652504c30+21:2360:x1874741431495040:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 484us (5647us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893191.411344:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 12 00010000:00010000:2.0:1787893191.416713:0:15611:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb200/0x825e3f5022b4bcda lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893191.416734:0:15611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb200/0x825e3f5022b4bcda lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893191.416790:0:15611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:2.0:1787893191.416987:0:15611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa800/0x825e3f5022b4bcd3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3e0 expref: 22 pid: 15611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893191.417284:0:15611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb200/0x825e3f5022b4bcda lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3e0 expref: 21 pid: 15611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893191.417299:0:15611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff907105cff500) 00010000:00010000:2.0:1787893191.417302:0:15611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787893191.417306:0:15611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9071421fb200, rc 0) 00000100:00100000:2.0:1787893191.417399:0:15611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0bf598c2-503d-4eab-8bcc-148652504c30+21:14558:x1874741431494784:12345-192.168.202.29@tcp:101:bash.0 Request processed in 20661us (20871us total) trans 8589934616 rc 0/0 00000100:00100000:2.0:1787893191.417410:0:15611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 40 00000100:00100000:2.0:1787893191.424661:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893191.424850:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431495296 00000100:00100000:1.0:1787893191.424860:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431495296 00000100:00100000:1.0:1787893191.424912:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 41 00000100:00100000:1.0:1787893191.424923:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f535180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bf598c2-503d-4eab-8bcc-148652504c30+21:14558:x1874741431495296:12345-192.168.202.29@tcp:36:bash.0 00010000:00010000:1.0:1787893191.425376:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4bce8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893191.425395:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4bce8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893191.425407:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4bce8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787893191.425463:0:14438:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:1.0:1787893191.425488:0:14438:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001c478152 reply state 00000000faf424f7 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4bce8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893191.425498:0:14438:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787893191.425640:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f535180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bf598c2-503d-4eab-8bcc-148652504c30+24:14558:x1874741431495296:12345-192.168.202.29@tcp:36:bash.0 Request processed in 718us (996us total) trans 8589934618 rc 0/0 00000100:00100000:1.0:1787893191.425648:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 41 00000020:00080000:1.0:1787893191.425654:0:14438:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787893191.435369:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4bce8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893191.435388:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4bce8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893191.435396:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4bce8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893191.435401:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9071421fa400 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893191.435406:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4bce8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893191.435414:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4bce8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893191.435433:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff907105cff500) 00010000:00010000:2.0:1787893191.435436:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893191.435458:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4bce8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893191.435465:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fa400/0x825e3f5022b4bce8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893191.441120:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893191.441306:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431495424 00000100:00100000:0.0:1787893191.441318:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431495424 00000100:00100000:0.0:1787893191.441387:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 42 00000100:00100000:0.0:1787893191.441398:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f535f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bf598c2-503d-4eab-8bcc-148652504c30+23:14558:x1874741431495424:12345-192.168.202.29@tcp:101:bash.0 00010000:00010000:0.0:1787893191.441426:0:14439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893191.441449:0:14439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4bcef lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b3e7 expref: -99 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893191.441509:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4bcef lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3e7 expref: 24 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893191.441526:0:14439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4bcef lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3e7 expref: 24 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893191.441547:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff907105cff500) 00010000:00010000:0.0:1787893191.441550:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787893191.441554:0:14439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907137fc8000, rc 0) 00000100:00100000:0.0:1787893191.441625:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f535f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bf598c2-503d-4eab-8bcc-148652504c30+24:14558:x1874741431495424:12345-192.168.202.29@tcp:101:bash.0 Request processed in 229us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893191.441633:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 42 00000100:00100000:0.0:1787893191.456884:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893191.457049:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431495552 00000100:00100000:2.0:1787893191.457061:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431495552 00000100:00100000:2.0:1787893191.457135:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 43 00000100:00100000:2.0:1787893191.457146:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105af8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bf598c2-503d-4eab-8bcc-148652504c30+24:14558:x1874741431495552:12345-192.168.202.29@tcp:101:bash.0 00010000:00010000:2.0:1787893191.457169:0:14437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893191.457192:0:14437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4bcf6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b3ee expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893191.457282:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4bcfd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893191.457298:0:14437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb200/0x825e3f5022b4bcda lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3e0 expref: 25 pid: 15611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893191.457308:0:14437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4bcfd lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893191.457342:0:14437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb200/0x825e3f5022b4bcda lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3e0 expref: 25 pid: 15611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893191.457357:0:14437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb200/0x825e3f5022b4bcda lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3e0 expref: 25 pid: 15611 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893191.457393:0:14437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f536300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14437:1874741455597696:192.168.202.29@tcp:104: 00000100:00100000:2.0:1787893191.457505:0:14437:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071296aa3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787893191.464455:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893191.465342:0:14437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f536300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14437:1874741455597696:192.168.202.29@tcp:104: 00010000:00010000:2.0:1787893191.465366:0:14437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4bcfd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893191.465394:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431495680 00000100:00100000:0.0:1787893191.465410:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431495680 00010000:00010000:0.0:1787893191.465454:0:14424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb200/0x825e3f5022b4bcda lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3e0 expref: 26 pid: 15611 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893191.465553:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 13 00000100:00100000:0.0:1787893191.465564:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f566300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0bf598c2-503d-4eab-8bcc-148652504c30+26:2361:x1874741431495680:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893191.465580:0:14424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893191.465589:0:14424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb200/0x825e3f5022b4bcda lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3e0 expref: 26 pid: 15611 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893191.465602:0:14424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb200/0x825e3f5022b4bcda lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3e0 expref: 26 pid: 15611 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893191.465625:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9071421fb200/0x825e3f5022b4bcda lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3e0 expref: 26 pid: 15611 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893191.465654:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff907105cff500) 00010000:00010000:0.0:1787893191.465660:0:14424:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4bcfd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893191.465668:0:14424:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4bcfd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893191.465676:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4bcfd lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893191.467260:0:14424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893191.467327:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f566300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0bf598c2-503d-4eab-8bcc-148652504c30+25:2361:x1874741431495680:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 1762us (2882us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893191.467350:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 13 00010000:00010000:2.0:1787893191.469951:0:14437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4bcfd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893191.469971:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4bcfd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893191.470050:0:14437:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787893191.470056:0:14437:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787893191.470161:0:14437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4bcfd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893191.470221:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4bcf6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3ee expref: 25 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893191.470247:0:14437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4bcfd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3ee expref: 24 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893191.470258:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff907105cff500) 00010000:00010000:2.0:1787893191.470261:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787893191.470265:0:14437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9f600, rc 0) 00000100:00100000:2.0:1787893191.470375:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105af8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bf598c2-503d-4eab-8bcc-148652504c30+24:14558:x1874741431495552:12345-192.168.202.29@tcp:101:bash.0 Request processed in 13225us (13495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893191.470411:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 43 00000100:00100000:1.0:1787893191.475813:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893191.475909:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431495936 00000100:00100000:2.0:1787893191.475920:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431495936 00000100:00100000:2.0:1787893191.476002:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 2 00000100:00100000:2.0:1787893191.476015:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f564e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0bf598c2-503d-4eab-8bcc-148652504c30+24:14558:x1874741431495936:12345-192.168.202.29@tcp:103:bash.0 00010000:00010000:2.0:1787893191.476032:0:14423:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787893191.476059:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4bcfd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3ee expref: 24 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893191.476202:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4bcef lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3e7 expref: 23 pid: 14439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893191.476218:0:14423:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff907105cff500) 00010000:00010000:2.0:1787893191.476229:0:14423:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787893191.476290:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f564e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0bf598c2-503d-4eab-8bcc-148652504c30+22:14558:x1874741431495936:12345-192.168.202.29@tcp:103:bash.0 Request processed in 277us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893191.476298:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 2 00000100:00100000:3.0:1787893191.482262:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893191.482441:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431496064 00000100:00100000:0.0:1787893191.482454:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431496064 00000100:00100000:0.0:1787893191.482517:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 44 00000100:00100000:0.0:1787893191.482527:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bf598c2-503d-4eab-8bcc-148652504c30+22:14558:x1874741431496064:12345-192.168.202.29@tcp:58:bash.0 00010000:00010000:0.0:1787893191.482627:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9c00/0x825e3f5022b4bd04 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893191.482644:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9c00/0x825e3f5022b4bd04 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893191.482654:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9c00/0x825e3f5022b4bd04 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787893191.490312:0:14439:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787893191.490747:0:14439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1787893191.491182:0:14439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1787893191.491373:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bf598c2-503d-4eab-8bcc-148652504c30+22:14558:x1874741431496064:12345-192.168.202.29@tcp:58:bash.0 Request processed in 8842us (9116us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893191.491386:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 44 00000100:00100000:1.0:1787893191.500152:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893191.500258:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431496192 00000100:00100000:2.0:1787893191.500269:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431496192 00000100:00100000:2.0:1787893191.500332:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 45 00000100:00100000:2.0:1787893191.500343:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f566a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bf598c2-503d-4eab-8bcc-148652504c30+22:14558:x1874741431496192:12345-192.168.202.29@tcp:101:bash.0 00010000:00010000:2.0:1787893191.500363:0:14438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893191.500383:0:14438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4bd0b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b3f5 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893191.500449:0:14438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9c00/0x825e3f5022b4bd04 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893191.500474:0:14438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4bd0b lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3f5 expref: 23 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893191.500507:0:14438:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9c00/0x825e3f5022b4bd04 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893191.500521:0:14438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4bd0b lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3f5 expref: 23 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893191.500536:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9071061f7300) 00010000:00010000:2.0:1787893191.500540:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787893191.500544:0:14438:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4bd0b lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3f5 expref: 23 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893191.500551:0:14438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9f600, rc 0) 00000100:00100000:2.0:1787893191.500614:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f566a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bf598c2-503d-4eab-8bcc-148652504c30+23:14558:x1874741431496192:12345-192.168.202.29@tcp:101:bash.0 Request processed in 272us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893191.500621:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 45 00010000:00010000:1.0:1787893191.945253:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787893192.329060:0:14469:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787893192.329071:0:14469:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787893192.329124:0:14469:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787893192.329132:0:14469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787893192.329265:0:14469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f565500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14469:1874741455597824:192.168.202.29@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787893192.329387:0:14469:0:(client.c:2715:ptlrpc_set_wait()) set ffff907002c159c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787893192.350979:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893192.351142:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431496320 00000100:00100000:1.0:1787893192.351153:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431496320 00000100:00100000:1.0:1787893192.351227:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 0 00000100:00100000:1.0:1787893192.351239:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0bf598c2-503d-4eab-8bcc-148652504c30+24:14559:x1874741431496320:12345-192.168.202.29@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1787893192.351329:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0bf598c2-503d-4eab-8bcc-148652504c30+24:14559:x1874741431496320:12345-192.168.202.29@tcp:900:lhsmtool_posix.0 Request processed in 92us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893192.351338:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 0 00000100:00080000:2.0:1787893192.351530:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787893192.357694:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893192.357821:0:15611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431496448 00000100:00100000:2.0:1787893192.357832:0:15611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431496448 00000100:00100000:2.0:1787893192.357889:0:15611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 46 00000100:00100000:2.0:1787893192.357901:0:15611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f566680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0bf598c2-503d-4eab-8bcc-148652504c30+24:14559:x1874741431496448:12345-192.168.202.29@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787893192.357934:0:15611:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787893192.358058:0:15611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f566680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0bf598c2-503d-4eab-8bcc-148652504c30+24:14559:x1874741431496448:12345-192.168.202.29@tcp:53:lhsmtool_posix.0 Request processed in 159us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893192.358094:0:15611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 46 00000100:00100000:0.0:1787893192.359862:0:14469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f565500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14469:1874741455597824:192.168.202.29@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787893192.370593:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893192.370696:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431496576 00000100:00100000:2.0:1787893192.370707:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431496576 00000100:00100000:2.0:1787893192.370782:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 47 00000100:00100000:2.0:1787893192.370793:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bf598c2-503d-4eab-8bcc-148652504c30+23:14559:x1874741431496576:12345-192.168.202.29@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787893192.370871:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4bd12 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.370888:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4bd12 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.370902:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4bd12 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.370942:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4bd19 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.370950:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4bd19 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.370957:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4bd19 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.370988:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bd20 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.370997:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bd20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.371004:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bd20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893192.371057:0:14438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787893192.371062:0:14438:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787893192.371075:0:14438:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bd20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.371086:0:14438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4bd12 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.371092:0:14438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4bd12 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.371099:0:14438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4bd12 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.371105:0:14438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9fc00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893192.371109:0:14438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4bd12 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.371117:0:14438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4bd12 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.371131:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff907105cff700) 00010000:00010000:2.0:1787893192.371134:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893192.371138:0:14438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4bd12 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.371144:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4bd12 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.371157:0:14438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4bd19 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.371173:0:14438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4bd19 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.371179:0:14438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4bd19 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.371183:0:14438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9f400 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893192.371186:0:14438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4bd19 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.371192:0:14438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4bd19 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.371199:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff907105cff500) 00010000:00010000:2.0:1787893192.371202:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893192.371204:0:14438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4bd19 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.371210:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4bd19 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.371224:0:14438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bd20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.371229:0:14438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bd20 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.371234:0:14438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bd20 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.371238:0:14438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9ee00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893192.371247:0:14438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bd20 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.371253:0:14438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bd20 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.371260:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9071061f7300) 00010000:00010000:2.0:1787893192.371262:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893192.371264:0:14438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bd20 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.371269:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bd20 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893192.371344:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bf598c2-503d-4eab-8bcc-148652504c30+23:14559:x1874741431496576:12345-192.168.202.29@tcp:34:lhsmtool_posix.0 Request processed in 553us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893192.371353:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 47 00000100:00100000:3.0:1787893192.375815:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893192.375953:0:15611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431496832 00000100:00100000:2.0:1787893192.375967:0:15611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431496832 00000100:00100000:2.0:1787893192.376043:0:15611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 48 00000100:00100000:2.0:1787893192.376053:0:15611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e2f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0bf598c2-503d-4eab-8bcc-148652504c30+23:14559:x1874741431496832:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787893192.376086:0:15611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893192.376109:0:15611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4bd27 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b3fc expref: -99 pid: 15611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.376208:0:15611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4bd2e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.376234:0:15611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4bd2e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.376267:0:15611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4bd2e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893192.376281:0:15611:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787893192.376388:0:15611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4bd2e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.376396:0:15611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4bd2e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.376402:0:15611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4bd2e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.376408:0:15611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9ea00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893192.376413:0:15611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4bd2e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.376421:0:15611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4bd2e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.376434:0:15611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9071061f7300) 00010000:00010000:2.0:1787893192.376437:0:15611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787893192.376441:0:15611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4bd2e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.376447:0:15611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4bd2e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.376489:0:15611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4bd27 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3fc expref: 25 pid: 15611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.376514:0:15611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff907105cff700) 00010000:00010000:2.0:1787893192.376517:0:15611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787893192.376521:0:15611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4bd27 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3fc expref: 25 pid: 15611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.376532:0:15611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9ec00, rc 0) 00000100:00100000:2.0:1787893192.376622:0:15611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e2f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0bf598c2-503d-4eab-8bcc-148652504c30+24:14559:x1874741431496832:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 Request processed in 562us (860us total) trans 8589934619 rc 301/301 00000100:00100000:2.0:1787893192.376631:0:15611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 48 00000100:00100000:1.0:1787893192.380421:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893192.380580:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431496960 00000100:00100000:2.0:1787893192.380591:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431496960 00000100:00100000:2.0:1787893192.380653:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 49 00000100:00100000:2.0:1787893192.380664:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f567b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bf598c2-503d-4eab-8bcc-148652504c30+24:14559:x1874741431496960:12345-192.168.202.29@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787893192.380705:0:14438:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787893192.380854:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f567b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bf598c2-503d-4eab-8bcc-148652504c30+24:14559:x1874741431496960:12345-192.168.202.29@tcp:53:lhsmtool_posix.0 Request processed in 190us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893192.380862:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 49 00000100:00100000:0.0:1787893192.385597:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893192.385805:0:15611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431497216 00000100:00100000:2.0:1787893192.385818:0:15611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431497216 00000100:00100000:2.0:1787893192.385891:0:15611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 50 00000100:00100000:2.0:1787893192.385902:0:15611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105af9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0bf598c2-503d-4eab-8bcc-148652504c30+24:14559:x1874741431497216:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787893192.385924:0:15611:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893192.385955:0:15611:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bd3c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b403 expref: -99 pid: 15611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787893192.390517:0:15611:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:2.0:1787893192.390529:0:15611:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:2.0:1787893192.390577:0:15611:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:2.0:1787893192.390908:0:15611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4bd43 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.390927:0:15611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4bd43 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.390940:0:15611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4bd43 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.391023:0:15611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bd3c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b403 expref: 27 pid: 15611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.391044:0:15611:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4bd43 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b403 expref: 26 pid: 15611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.391053:0:15611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff907105cff500) 00010000:00010000:2.0:1787893192.391056:0:15611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787893192.391059:0:15611:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9f400, rc 0) 00000100:00100000:2.0:1787893192.391141:0:15611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105af9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0bf598c2-503d-4eab-8bcc-148652504c30+26:14559:x1874741431497216:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 Request processed in 5240us (5554us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1787893192.391151:0:15611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 50 00000100:00100000:3.0:1787893192.397394:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90712e2f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455597952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787893192.397491:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893192.397565:0:15122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455597952 00000100:00100000:3.0:1787893192.397573:0:15122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455597952 00000100:00100000:3.0:1787893192.397631:0:15122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787893192.397641:0:15122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90712e62a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455597952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787893192.397688:0:15122:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787893192.397735:0:15122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90712e62a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455597952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893192.397742:0:15122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787893192.397844:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f31ac154-369d-4473-bca1-5cb1596e1d9c:3305:1874741455598080:0@lo:400:kworker.0 00000100:00100000:3.0:1787893192.397888:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893192.397913:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137e49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874741455598592:0@lo:400:kworker.0 00000100:00100000:3.0:1787893192.397938:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893192.397954:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787893192.397959:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137d3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455598208:0@lo:400:kworker.0 00000100:00100000:3.0:1787893192.397991:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893192.398018:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455598080 00000100:00100000:3.0:1787893192.398022:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455598080 00000100:00100000:3.0:1787893192.398046:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787893192.398052:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907106340850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+19:3305:x1874741455598080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893192.398088:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907106340850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f31ac154-369d-4473-bca1-5cb1596e1d9c+19:3305:x1874741455598080:12345-0@lo:400:kworker.0 Request processed in 34us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893192.398110:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787893192.398137:0:15850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455598208 00000100:00100000:3.0:1787893192.398140:0:15850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455598208 00000100:00100000:3.0:1787893192.398166:0:15850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787893192.398172:0:15850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137e4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455598208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893192.398205:0:15850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137e4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874741455598208:12345-0@lo:400:kworker.0 Request processed in 33us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893192.398211:0:15850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787893192.398229:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137e49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874741455598336:0@lo:400:kworker.0 00000100:00100000:3.0:1787893192.398252:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787893192.398269:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787893192.398274:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907137e48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874741455598464:0@lo:400:kworker.0 00000100:00100000:3.0:1787893192.398294:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787893192.398316:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787893192.398319:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787893192.398344:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1874741455598208:0@lo:400:kworker.0 00000100:00100000:3.0:1787893192.398353:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137d3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f31ac154-369d-4473-bca1-5cb1596e1d9c:3305:1874741455598080:0@lo:400:kworker.0 00000100:00100000:3.0:1787893192.398388:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90712e2f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455597952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787893192.398407:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455598592 00000100:00100000:3.0:1787893192.398411:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455598592 00000100:00080000:3.0:1787893192.398428:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787893192.398449:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455598336 00000100:00100000:3.0:1787893192.398452:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455598336 00000100:00100000:3.0:1787893192.398463:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455598464 00000100:00100000:3.0:1787893192.398465:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455598464 00000100:00080000:3.0:1787893192.398476:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787893192.398500:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787893192.398507:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874741455598592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893192.398543:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137e4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874741455598592:12345-0@lo:400:kworker.0 Request processed in 37us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893192.398550:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787893192.398587:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137e49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1874741455598592:0@lo:400:kworker.0 00000100:00100000:3.0:1787893192.398606:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787893192.398612:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137e4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874741455598336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893192.398647:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137e4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874741455598336:12345-0@lo:400:kworker.0 Request processed in 35us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893192.398653:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787893192.398675:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137e49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874741455598336:0@lo:400:kworker.0 00000100:00100000:3.0:1787893192.398693:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787893192.398699:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137e48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874741455598464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787893192.398746:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137e48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874741455598464:12345-0@lo:400:kworker.0 Request processed in 46us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893192.398772:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787893192.398794:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907137e48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1874741455598464:0@lo:400:kworker.0 00000100:00100000:2.0:1787893192.411656:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893192.414745:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431497472 00000100:00100000:0.0:1787893192.414776:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431497472 00000100:00100000:0.0:1787893192.414835:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 51 00000100:00100000:0.0:1787893192.414846:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f536300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bf598c2-503d-4eab-8bcc-148652504c30+26:14559:x1874741431497472:12345-192.168.202.29@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787893192.414905:0:14439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893192.414930:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f400/0x825e3f5022b4bd43 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b403 expref: 26 pid: 15611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.414950:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff907105cff500) 00010000:00010000:0.0:1787893192.414960:0:14439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787893192.414993:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4bd51 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.415018:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4bd51 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.415027:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4bd51 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.415076:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4bd58 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x429f2a99 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.415083:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4bd58 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x429f2a99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.415088:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4bd58 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x429f2a99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.415334:0:14439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4bd51 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.415341:0:14439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4bd51 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.415348:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4bd51 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.415354:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc8400 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:0.0:1787893192.415358:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4bd51 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.415366:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4bd51 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.415374:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff907104d8ef00) 00010000:00010000:0.0:1787893192.415382:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893192.415386:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4bd51 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.415392:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4bd51 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.415403:0:14439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4bd58 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x429f2a99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.415408:0:14439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4bd58 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x429f2a99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.415413:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4bd58 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x429f2a99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.415417:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc9a00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:0.0:1787893192.415420:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4bd58 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x429f2a99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.415425:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4bd58 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x429f2a99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.415433:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x429f2a99 (ffff9071061f7100) 00010000:00010000:0.0:1787893192.415435:0:14439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893192.415438:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4bd58 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x429f2a99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.415442:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9a00/0x825e3f5022b4bd58 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x429f2a99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893192.415534:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f536300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bf598c2-503d-4eab-8bcc-148652504c30+25:14559:x1874741431497472:12345-192.168.202.29@tcp:36:lhsmtool_posix.0 Request processed in 688us (3888us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787893192.415547:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 51 00000100:00100000:1.0:1787893192.426946:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893192.429469:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431497600 00000100:00100000:2.0:1787893192.429484:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431497600 00000100:00100000:2.0:1787893192.429558:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 52 00000100:00100000:2.0:1787893192.429569:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f565500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bf598c2-503d-4eab-8bcc-148652504c30+25:14559:x1874741431497600:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787893192.429589:0:14438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893192.429611:0:14438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bd5f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b40a expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.429648:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4bd66 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.429660:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4bd66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.429671:0:14438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4bd66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.429781:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bd5f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b40a expref: 27 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.429800:0:14438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ec00/0x825e3f5022b4bd66 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b40a expref: 26 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.429809:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff907105cffd00) 00010000:00010000:2.0:1787893192.429823:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787893192.429827:0:14438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9ec00, rc 0) 00000100:00100000:2.0:1787893192.429901:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f565500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bf598c2-503d-4eab-8bcc-148652504c30+26:14559:x1874741431497600:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 Request processed in 333us (2963us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893192.429908:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 52 00000100:00100000:0.0:1787893192.436141:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893192.436202:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431497856 00000100:00100000:2.0:1787893192.436213:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431497856 00000100:00100000:2.0:1787893192.436306:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 53 00000100:00100000:2.0:1787893192.436316:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105af9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bf598c2-503d-4eab-8bcc-148652504c30+26:14559:x1874741431497856:12345-192.168.202.29@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787893192.436406:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4bd6d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.436438:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4bd6d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.436451:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4bd6d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787893192.437163:0:14437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1787893192.437181:0:14437:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 520204423397ns, next at 521204420767ns, rc = 0 00000004:00010000:2.0:1787893192.437276:0:14437:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000002b8241a reply state 00000000253a6ff2 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4bd6d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893192.437286:0:14437:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787893192.437448:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105af9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bf598c2-503d-4eab-8bcc-148652504c30+28:14559:x1874741431497856:12345-192.168.202.29@tcp:36:lhsmtool_posix.0 Request processed in 1131us (1316us total) trans 8589934621 rc 0/0 00000100:00100000:2.0:1787893192.437457:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 53 00010000:00010000:2.0:1787893192.455037:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4bd6d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.455067:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4bd6d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.455074:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4bd6d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.455081:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9ea00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893192.455085:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4bd6d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.455105:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4bd6d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.455122:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff907105cffd00) 00010000:00010000:2.0:1787893192.455125:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787893192.455130:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4bd6d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.455137:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4bd6d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893192.456321:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893192.456573:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431497984 00000100:00100000:2.0:1787893192.456584:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431497984 00000100:00100000:2.0:1787893192.456691:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 54 00000100:00100000:2.0:1787893192.456704:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105af8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bf598c2-503d-4eab-8bcc-148652504c30+27:14559:x1874741431497984:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787893192.456728:0:14438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893192.456746:0:14438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bd74 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b411 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.456850:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bd74 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b411 expref: 28 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.456864:0:14438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bd74 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b411 expref: 28 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.456883:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff907105cffd00) 00010000:00010000:2.0:1787893192.456886:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787893192.456890:0:14438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9ee00, rc 0) 00000100:00100000:2.0:1787893192.456967:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105af8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bf598c2-503d-4eab-8bcc-148652504c30+28:14559:x1874741431497984:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 Request processed in 265us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893192.456974:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 54 00000100:00100000:0.0:1787893192.465941:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893192.466036:0:15121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431498112 00000100:00100000:3.0:1787893192.466060:0:15121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431498112 00000100:00100000:3.0:1787893192.466142:0:15121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 12 00000100:00100000:3.0:1787893192.466154:0:15121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105afa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0bf598c2-503d-4eab-8bcc-148652504c30+5:2360:x1874741431498112:12345-192.168.202.29@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787893192.466545:0:15121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105afa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0bf598c2-503d-4eab-8bcc-148652504c30+6:2360:x1874741431498112:12345-192.168.202.29@tcp:2:lhsmtool_posix.0 Request processed in 391us (613us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787893192.466571:0:15121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 12 00000100:00080000:0.0:1787893192.466769:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787893192.470395:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893192.470626:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431498368 00000100:00100000:0.0:1787893192.470636:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431498368 00000100:00100000:0.0:1787893192.470728:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 11 00000100:00100000:0.0:1787893192.470737:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90700198f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0bf598c2-503d-4eab-8bcc-148652504c30+28:14559:x1874741431498368:12345-192.168.202.29@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787893192.471028:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90700198f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0bf598c2-503d-4eab-8bcc-148652504c30+29:14559:x1874741431498368:12345-192.168.202.29@tcp:35:lhsmtool_posix.0 Request processed in 291us (644us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1787893192.471036:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 11 00000100:00100000:1.0:1787893192.474252:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893192.474370:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431498624 00000100:00100000:2.0:1787893192.474381:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431498624 00000100:00100000:2.0:1787893192.474604:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 55 00000100:00100000:2.0:1787893192.474617:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90700198df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bf598c2-503d-4eab-8bcc-148652504c30+29:14559:x1874741431498624:12345-192.168.202.29@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787893192.474913:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90700198df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bf598c2-503d-4eab-8bcc-148652504c30+29:14559:x1874741431498624:12345-192.168.202.29@tcp:57:lhsmtool_posix.0 Request processed in 298us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893192.474922:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 55 00000100:00100000:3.0:1787893192.478139:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893192.478310:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431498752 00000100:00100000:2.0:1787893192.478319:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431498752 00000100:00100000:2.0:1787893192.478376:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 56 00000100:00100000:2.0:1787893192.478386:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137e48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bf598c2-503d-4eab-8bcc-148652504c30+29:14559:x1874741431498752:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787893192.478406:0:14437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893192.478585:0:14437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4bd7b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b418 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.478685:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4bd82 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.478701:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4bd82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.478713:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4bd82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893192.478748:0:14437:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787893192.478849:0:14437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4bd82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.478875:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4bd7b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b418 expref: 31 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.478893:0:14437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4bd82 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b418 expref: 30 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.478902:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff907105cffd00) 00010000:00010000:2.0:1787893192.478905:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787893192.478909:0:14437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9ea00, rc 0) 00000100:00100000:2.0:1787893192.479082:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137e48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bf598c2-503d-4eab-8bcc-148652504c30+30:14559:x1874741431498752:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 Request processed in 697us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893192.479090:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 56 00000100:00100000:3.0:1787893192.482044:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893192.482142:0:15850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431498880 00000100:00100000:0.0:1787893192.482152:0:15850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431498880 00000100:00100000:0.0:1787893192.482232:0:15850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 13 00000100:00100000:0.0:1787893192.482242:0:15850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137e49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0bf598c2-503d-4eab-8bcc-148652504c30+6:2361:x1874741431498880:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787893192.482259:0:15850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893192.482278:0:15850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce5c6b05/0x825e3f5022b4bd89 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b41f expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787893192.482305:0:15850:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9115c8, blocks: 0x1 00010000:00010000:0.0:1787893192.482324:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=520s v=(0 0) 00010000:00010000:0.0:1787893192.482328:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787893192.482337:0:15850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce5c6b05/0x825e3f5022b4bd89 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b41f expref: 7 pid: 15850 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.482373:0:15850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ce5c6b05/0x825e3f5022b4bd89 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b41f expref: 7 pid: 15850 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.482385:0:15850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907137fc8400, rc 0) 00000100:00100000:0.0:1787893192.482564:0:15850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137e49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0bf598c2-503d-4eab-8bcc-148652504c30+7:2361:x1874741431498880:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 Request processed in 323us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893192.482572:0:15850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 13 00000100:00100000:1.0:1787893192.485582:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893192.485944:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431499136 00000100:00100000:0.0:1787893192.485966:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431499136 00000100:00100000:0.0:1787893192.486039:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 57 00000100:00100000:0.0:1787893192.486051:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90700198f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bf598c2-503d-4eab-8bcc-148652504c30+30:14559:x1874741431499136:12345-192.168.202.29@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787893192.486168:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90700198f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bf598c2-503d-4eab-8bcc-148652504c30+30:14559:x1874741431499136:12345-192.168.202.29@tcp:57:lhsmtool_posix.0 Request processed in 119us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893192.486175:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 57 00000100:00100000:2.0:1787893192.495603:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893192.495736:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431499264 00000100:00100000:0.0:1787893192.495748:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431499264 00000100:00100000:0.0:1787893192.495836:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 58 00000100:00100000:0.0:1787893192.495847:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f534a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bf598c2-503d-4eab-8bcc-148652504c30+30:14559:x1874741431499264:12345-192.168.202.29@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787893192.565422:0:5870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:3.0:1787893192.565590:0:5870:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:0.0:1787893192.565891:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f534a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bf598c2-503d-4eab-8bcc-148652504c30+19:14559:x1874741431499264:12345-192.168.202.29@tcp:44:lhsmtool_posix.0 Request processed in 70039us (70291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893192.565903:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 58 00000100:00100000:0.0:1787893192.567442:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f536d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455598720:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787893192.567612:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787893192.567830:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455598720 00000100:00100000:2.0:1787893192.567839:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455598720 00000100:00100000:2.0:1787893192.567891:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787893192.567901:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105af9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874741455598720:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1787893192.568211:0:15119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787893192.568215:0:15119:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1787893192.568217:0:15119:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787893192.568219:0:15119:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787893192 -> 1787893192 00002000:00010000:2.0:1787893192.568221:0:15119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787893192.568364:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105af9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1874741455598720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 463us (752us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1787893192.568373:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787893192.570407:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893192.570499:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431499392 00000100:00100000:1.0:1787893192.570507:0:15120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431499392 00000100:00100000:1.0:1787893192.570556:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 15 00000100:00100000:1.0:1787893192.570565:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137e49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0bf598c2-503d-4eab-8bcc-148652504c30+7:2363:x1874741431499392:12345-192.168.202.29@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787893192.570656:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137e49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0bf598c2-503d-4eab-8bcc-148652504c30+7:2363:x1874741431499392:12345-192.168.202.29@tcp:16:lhsmtool_posix.0 Request processed in 91us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893192.570664:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 15 00000100:00100000:1.0:1787893192.573369:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893192.573471:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431499648 00000100:00100000:3.0:1787893192.573493:0:14439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431499648 00000100:00100000:3.0:1787893192.573601:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 59 00000100:00100000:3.0:1787893192.573612:0:14439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90700198ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bf598c2-503d-4eab-8bcc-148652504c30+13:14559:x1874741431499648:12345-192.168.202.29@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787893192.573829:0:14439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893192.573861:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4bd82 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b418 expref: 13 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893192.573881:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff907105cffd00) 00010000:00010000:3.0:1787893192.573885:0:14439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787893192.573917:0:14439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bd90 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893192.573930:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bd90 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893192.573940:0:14439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bd90 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787893192.574236:0:14439:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000edb7703d reply state 00000000e54e8c10 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bd90 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893192.574265:0:14439:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787893192.574358:0:14439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90700198ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0bf598c2-503d-4eab-8bcc-148652504c30+14:14559:x1874741431499648:12345-192.168.202.29@tcp:36:lhsmtool_posix.0 Request processed in 746us (999us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1787893192.574365:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 59 00000004:00080000:0.0:1787893192.575222:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90713f536d80/2, rc 0, transno 8589934595 00000100:00100000:0.0:1787893192.575233:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f536d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1874741455598720:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787893192.578868:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893192.579178:0:15121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431499776 00000100:00100000:0.0:1787893192.579188:0:15121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431499776 00000100:00100000:0.0:1787893192.579243:0:15121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 16 00000100:00100000:0.0:1787893192.579253:0:15121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f534700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0bf598c2-503d-4eab-8bcc-148652504c30+7:14559:x1874741431499776:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787893192.579271:0:15121:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787893192.579290:0:15121:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd491752/0x825e3f5022b4bd97 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b426 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.579321:0:15121:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ce5c6b05/0x825e3f5022b4bd89 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b41f expref: 8 pid: 15850 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.579329:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787893192.579333:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787893192.579338:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd491752/0x825e3f5022b4bd97 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b426 expref: 8 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.579372:0:15121:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ce5c6b05/0x825e3f5022b4bd89 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b41f expref: 8 pid: 15850 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.579385:0:15121:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ce5c6b05/0x825e3f5022b4bd89 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b41f expref: 8 pid: 15850 timeout: 620 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893192.579400:0:15121:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907105afad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15121:1874741455598848:192.168.202.29@tcp:104: 00000100:00100000:0.0:1787893192.579501:0:15121:0:(client.c:2715:ptlrpc_set_wait()) set ffff907104fcaf00 going to sleep for 11 seconds 00010000:00010000:3.0:1787893192.579781:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bd90 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893192.579790:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bd90 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893192.579796:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bd90 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893192.579802:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907104f46200 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:3.0:1787893192.579807:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bd90 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893192.579814:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bd90 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893192.579829:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff907105cffd00) 00010000:00010000:3.0:1787893192.579832:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787893192.579836:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bd90 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893192.579841:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907104f46200/0x825e3f5022b4bd90 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893192.583418:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893192.584133:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431499904 00000100:00100000:2.0:1787893192.584144:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431499904 00010000:00010000:2.0:1787893192.584188:0:14424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ce5c6b05/0x825e3f5022b4bd89 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b41f expref: 9 pid: 15850 timeout: 620 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893192.584233:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 14 00000100:00100000:2.0:1787893192.584244:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0bf598c2-503d-4eab-8bcc-148652504c30+9:2360:x1874741431499904:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787893192.584260:0:14424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787893192.584282:0:14424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ce5c6b05/0x825e3f5022b4bd89 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b41f expref: 9 pid: 15850 timeout: 620 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.584296:0:14424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ce5c6b05/0x825e3f5022b4bd89 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b41f expref: 9 pid: 15850 timeout: 620 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.584319:0:14424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893192.584324:0:14424:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893192.584332:0:14424:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd491752/0x825e3f5022b4bd97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b426 expref: 9 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.584343:0:14424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd491752/0x825e3f5022b4bd97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b426 expref: 9 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.584383:0:14424:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dd491752/0x825e3f5022b4bd97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b426 expref: 9 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893192.584421:0:14424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f534380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14424:1874741455598976:192.168.202.29@tcp:105: 00000100:00100000:2.0:1787893192.584529:0:14424:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071296aa240 going to sleep for 11 seconds 00010000:00010000:0.0:1787893192.587848:0:15121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce5c6b05/0x825e3f5022b4bd89 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b41f expref: 9 pid: 15850 timeout: 620 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893192.587875:0:15121:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907105afad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15121:1874741455598848:192.168.202.29@tcp:104: 00010000:00010000:0.0:1787893192.587907:0:15121:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dd491752/0x825e3f5022b4bd97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b426 expref: 8 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.587924:0:15121:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907137fc8a00, rc 0) 00000100:00100000:0.0:1787893192.588015:0:15121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f534700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0bf598c2-503d-4eab-8bcc-148652504c30+8:14559:x1874741431499776:12345-192.168.202.29@tcp:101:lhsmtool_posix.0 Request processed in 8761us (9156us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893192.588024:0:15121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 16 00000100:00100000:0.0:1787893192.589251:0:14424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f534380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14424:1874741455598976:192.168.202.29@tcp:105: 00010000:00010000:0.0:1787893192.589270:0:14424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893192.589314:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0bf598c2-503d-4eab-8bcc-148652504c30+7:2360:x1874741431499904:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 5073us (5910us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893192.589323:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 14 00000100:00100000:1.0:1787893192.594082:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893192.594398:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431500032 00000100:00100000:2.0:1787893192.594409:0:15120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431500032 00000100:00100000:2.0:1787893192.594469:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 17 00000100:00100000:2.0:1787893192.594488:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0bf598c2-503d-4eab-8bcc-148652504c30+7:2362:x1874741431500032:12345-192.168.202.29@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787893192.594989:0:15120:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787893192.594994:0:15120:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787893191 00002000:00010000:2.0:1787893192.594997:0:15120:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787893189 00002000:00010000:2.0:1787893192.594999:0:15120:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787893192 -> 1787893191 00002000:00010000:2.0:1787893192.595001:0:15120:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787893192.595058:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0bf598c2-503d-4eab-8bcc-148652504c30+8:2362:x1874741431500032:12345-192.168.202.29@tcp:2:lhsmtool_posix.0 Request processed in 579us (995us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1787893192.595066:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 17 00000100:00100000:3.0:1787893192.601056:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893192.601412:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431500160 00000100:00100000:2.0:1787893192.601434:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431500160 00000100:00100000:2.0:1787893192.601504:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 18 00000100:00100000:2.0:1787893192.601515:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137e4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0bf598c2-503d-4eab-8bcc-148652504c30+8:2363:x1874741431500160:12345-192.168.202.29@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787893192.601562:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000054fb3861/0x825e3f5022b4bd9e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.601583:0:15119:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd491752/0x825e3f5022b4bd97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b426 expref: 8 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.601613:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787893192.601618:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787893192.601623:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054fb3861/0x825e3f5022b4bd9e lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.601661:0:15119:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dd491752/0x825e3f5022b4bd97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b426 expref: 8 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.601823:0:15119:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dd491752/0x825e3f5022b4bd97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b426 expref: 8 pid: 15121 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893192.601839:0:15119:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f537100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15119:1874741455599104:192.168.202.29@tcp:104: 00000100:00100000:2.0:1787893192.601918:0:15119:0:(client.c:2715:ptlrpc_set_wait()) set ffff9071296aa9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787893192.606245:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893192.606422:0:15119:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f537100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15119:1874741455599104:192.168.202.29@tcp:104: 00010000:00010000:2.0:1787893192.606458:0:15119:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000054fb3861/0x825e3f5022b4bd9e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893192.606890:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431500288 00000100:00100000:3.0:1787893192.606911:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431500288 00010000:00010000:3.0:1787893192.606961:0:14423:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dd491752/0x825e3f5022b4bd97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b426 expref: 9 pid: 15121 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787893192.607009:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 15 00000100:00100000:3.0:1787893192.607020:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0bf598c2-503d-4eab-8bcc-148652504c30+9:2361:x1874741431500288:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787893192.607033:0:14423:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787893192.607056:0:14423:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dd491752/0x825e3f5022b4bd97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b426 expref: 9 pid: 15121 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893192.607068:0:14423:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dd491752/0x825e3f5022b4bd97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b426 expref: 9 pid: 15121 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893192.607189:0:14423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd491752/0x825e3f5022b4bd97 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b426 expref: 9 pid: 15121 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893192.607206:0:14423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787893192.607211:0:14423:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787893192.607216:0:14423:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000054fb3861/0x825e3f5022b4bd9e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893192.607226:0:14423:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054fb3861/0x825e3f5022b4bd9e lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893192.607255:0:14423:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787893192.607318:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0bf598c2-503d-4eab-8bcc-148652504c30+8:2361:x1874741431500288:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 299us (1082us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893192.607332:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 15 00010000:00010000:2.0:1787893192.608317:0:15119:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000054fb3861/0x825e3f5022b4bd9e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.608330:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054fb3861/0x825e3f5022b4bd9e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.608357:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000054fb3861/0x825e3f5022b4bd9e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.608374:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054fb3861/0x825e3f5022b4bd9e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.608381:0:15119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054fb3861/0x825e3f5022b4bd9e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.608387:0:15119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9ea00 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:2.0:1787893192.608391:0:15119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054fb3861/0x825e3f5022b4bd9e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.608399:0:15119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054fb3861/0x825e3f5022b4bd9e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.608414:0:15119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054fb3861/0x825e3f5022b4bd9e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.608422:0:15119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054fb3861/0x825e3f5022b4bd9e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893192.608606:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137e4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0bf598c2-503d-4eab-8bcc-148652504c30+7:2363:x1874741431500160:12345-192.168.202.29@tcp:1:lhsmtool_posix.0 Request processed in 7090us (7557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893192.608614:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 18 00000100:00100000:1.0:1787893192.618013:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893192.618273:0:15611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431500544 00000100:00100000:0.0:1787893192.618286:0:15611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431500544 00000100:00100000:0.0:1787893192.618352:0:15611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 60 00000100:00100000:0.0:1787893192.618363:0:15611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070038c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0bf598c2-503d-4eab-8bcc-148652504c30+13:14559:x1874741431500544:12345-192.168.202.29@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787893192.618464:0:15611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4bda5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.618483:0:15611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4bda5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.618495:0:15611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4bda5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.619473:0:15611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4bdac lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.619492:0:15611:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bd74 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b411 expref: 14 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.619501:0:15611:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4bdac lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.619543:0:15611:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bd74 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b411 expref: 14 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.619560:0:15611:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bd74 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b411 expref: 14 pid: 14438 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893192.619577:0:15611:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907105afad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15611:1874741455599232:192.168.202.29@tcp:104: 00000100:00100000:2.0:1787893192.621219:0:15611:0:(client.c:2715:ptlrpc_set_wait()) set ffff907104fca300 going to sleep for 11 seconds 00000100:00100000:2.0:1787893192.626789:0:15611:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907105afad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15611:1874741455599232:192.168.202.29@tcp:104: 00010000:00010000:2.0:1787893192.626839:0:15611:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4bdac lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787893192.628389:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:0.0:1787893192.629060:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431500672 00000100:00100000:0.0:1787893192.629080:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431500672 00010000:00010000:0.0:1787893192.629120:0:14424:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bd74 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b411 expref: 15 pid: 14438 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893192.629157:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 16 00000100:00100000:0.0:1787893192.629166:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9070010cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0bf598c2-503d-4eab-8bcc-148652504c30+15:2361:x1874741431500672:12345-192.168.202.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787893192.629180:0:14424:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787893192.629187:0:14424:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bd74 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b411 expref: 15 pid: 14438 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.629216:0:14424:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bd74 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b411 expref: 15 pid: 14438 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.629239:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bd74 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b411 expref: 15 pid: 14438 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.629258:0:14424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff907105cffd00) 00010000:00010000:0.0:1787893192.629264:0:14424:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4bdac lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.629274:0:14424:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4bdac lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.629282:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4bdac lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.629313:0:14424:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787893192.629368:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070010cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0bf598c2-503d-4eab-8bcc-148652504c30+14:2361:x1874741431500672:12345-192.168.202.29@tcp:103:ldlm_bl.0 Request processed in 202us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893192.629375:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 16 00010000:00010000:1.0:1787893192.630691:0:15611:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4bdac lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893192.630704:0:15611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4bdac lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787893192.630968:0:15611:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:1.0:1787893192.631137:0:15611:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:1.0:1787893192.631180:0:15611:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:1.0:1787893192.631263:0:15611:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9070010cea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15611:1874741455599360:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787893192.631361:0:15611:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893192.631395:0:15611:0:(client.c:2715:ptlrpc_set_wait()) set ffff907107ed3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787893192.631715:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455599360 00000100:00100000:3.0:1787893192.631722:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455599360 00000100:00100000:3.0:1787893192.631791:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787893192.631800:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f90c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15611:x1874741455599360:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787893192.631884:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f90c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15611:x1874741455599360:12345-0@lo:1000:mdt00_003.0 Request processed in 84us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893192.631892:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787893192.632362:0:15611:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9070010cea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15611:1874741455599360:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1787893192.635342:0:15611:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:1.0:1787893192.635657:0:15611:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f90c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15611:1874741455599488:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787893192.635735:0:15611:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893192.635800:0:15611:0:(client.c:2715:ptlrpc_set_wait()) set ffff907107ed3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787893192.635940:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455599488 00000100:00100000:3.0:1787893192.635958:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455599488 00000100:00100000:3.0:1787893192.636017:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787893192.636027:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f90ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15611:x1874741455599488:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787893192.636214:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f90ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:15611:x1874741455599488:12345-0@lo:1000:mdt00_003.0 Request processed in 188us (477us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1787893192.636223:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787893192.636392:0:15611:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f90c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15611:1874741455599488:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1787893192.636436:0:15611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4bdac lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893192.636448:0:15611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4bdac lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893192.636455:0:15611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4bdac lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893192.636461:0:15611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc8400 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893192.636466:0:15611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4bdac lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893192.636585:0:15611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4bdac lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893192.636605:0:15611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff907105cffd00) 00010000:00010000:1.0:1787893192.636608:0:15611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787893192.636613:0:15611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4bdac lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893192.636620:0:15611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8400/0x825e3f5022b4bdac lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893192.636654:0:15611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9c00/0x825e3f5022b4bd04 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893192.636661:0:15611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9c00/0x825e3f5022b4bd04 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893192.637144:0:15611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9c00/0x825e3f5022b4bd04 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893192.637149:0:15611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc9c00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:1.0:1787893192.637152:0:15611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9c00/0x825e3f5022b4bd04 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893192.637158:0:15611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9c00/0x825e3f5022b4bd04 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893192.637167:0:15611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9071061f7300) 00010000:00010000:1.0:1787893192.637169:0:15611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787893192.637176:0:15611:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4bd0b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3f5 expref: 17 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893192.637186:0:15611:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4bd0b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3f5 expref: 17 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893192.637194:0:15611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4bd0b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3f5 expref: 17 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.638194:0:15611:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9f600/0x825e3f5022b4bd0b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b3f5 expref: 17 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787893192.638215:0:15611:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff907105af9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15611:1874741455599616:192.168.202.29@tcp:105: 00000100:00100000:0.0:1787893192.638294:0:15611:0:(client.c:2715:ptlrpc_set_wait()) set ffff907104fca300 going to sleep for 11 seconds 00000100:00100000:1.0:1787893192.643089:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893192.643192:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431500800 00000100:00100000:3.0:1787893192.643201:0:14440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431500800 00000100:00100000:3.0:1787893192.643260:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 12 00000100:00100000:3.0:1787893192.643270:0:14440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f90f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0bf598c2-503d-4eab-8bcc-148652504c30+18:14558:x1874741431500800:12345-192.168.202.29@tcp:49:bash.0 00000100:00100000:3.0:1787893192.643404:0:14440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f90f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0bf598c2-503d-4eab-8bcc-148652504c30+18:14558:x1874741431500800:12345-192.168.202.29@tcp:49:bash.0 Request processed in 135us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893192.643412:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 12 00000100:00100000:0.0:1787893192.647029:0:15611:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff907105af9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15611:1874741455599616:192.168.202.29@tcp:105: 00010000:00010000:0.0:1787893192.647061:0:15611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9c00/0x825e3f5022b4bd04 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.647099:0:15611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9c00/0x825e3f5022b4bd04 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.647131:0:15611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4bdb3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.647145:0:15611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4bdb3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.647157:0:15611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4bdb3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.647166:0:15611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4bdb3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.647173:0:15611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4bdb3 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.647179:0:15611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4bdb3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.647185:0:15611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc9e00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:0.0:1787893192.647189:0:15611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4bdb3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.647197:0:15611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4bdb3 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.647207:0:15611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9071061f7300) 00010000:00010000:0.0:1787893192.647209:0:15611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787893192.647212:0:15611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4bdb3 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.647224:0:15611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc9e00/0x825e3f5022b4bdb3 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.647234:0:15611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4bda5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.647240:0:15611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4bda5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.647246:0:15611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4bda5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.647251:0:15611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907137fc8000 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:0.0:1787893192.647254:0:15611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4bda5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.647259:0:15611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4bda5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.647267:0:15611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9071061f7300) 00010000:00010000:0.0:1787893192.647269:0:15611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787893192.647271:0:15611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4bda5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787893192.647277:0:15611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907137fc8000/0x825e3f5022b4bda5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15611 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787893192.647722:0:14469:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787893192.647727:0:14469:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787893192.647783:0:14469:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787893192.647789:0:14469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787893192.648563:0:15611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9070038c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0bf598c2-503d-4eab-8bcc-148652504c30+17:14559:x1874741431500544:12345-192.168.202.29@tcp:57:lhsmtool_posix.0 Request processed in 30196us (30554us total) trans 8589934628 rc 0/0 00000100:00100000:0.0:1787893192.648574:0:15611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 60 00000020:00080000:0.0:1787893192.648587:0:15611:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1787893192.652120:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893192.652274:0:15850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431500928 00000100:00100000:3.0:1787893192.652285:0:15850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431500928 00000100:00100000:3.0:1787893192.652340:0:15850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 19 00000100:00100000:3.0:1787893192.652349:0:15850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f90d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0bf598c2-503d-4eab-8bcc-148652504c30+7:14558:x1874741431500928:12345-192.168.202.29@tcp:101:bash.0 00010000:00010000:3.0:1787893192.652379:0:15850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787893192.652399:0:15850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060d3b585/0x825e3f5022b4bdba lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b42d expref: -99 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787893192.652442:0:15850:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a9115c7, atime: 0x6a9115c5, ctime: 0x6a9115c7, blocks: 0x1 00010000:00010000:3.0:1787893192.652462:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=520s v=(0 0) 00010000:00010000:3.0:1787893192.652467:0:15850:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787893192.652485:0:15850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060d3b585/0x825e3f5022b4bdba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b42d expref: 8 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893192.652501:0:15850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000060d3b585/0x825e3f5022b4bdba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b42d expref: 8 pid: 15850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787893192.652513:0:15850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907104f46200, rc 0) 00000100:00100000:3.0:1787893192.652570:0:15850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f90d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0bf598c2-503d-4eab-8bcc-148652504c30+8:14558:x1874741431500928:12345-192.168.202.29@tcp:101:bash.0 Request processed in 222us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893192.652577:0:15850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 19 00000100:00100000:1.0:1787893192.660038:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893192.660660:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431501184 00000100:00100000:3.0:1787893192.660680:0:14440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431501184 00000100:00100000:3.0:1787893192.660740:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 13 00000100:00100000:3.0:1787893192.660787:0:14440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90713f90c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0bf598c2-503d-4eab-8bcc-148652504c30+17:14559:x1874741431501184:12345-192.168.202.29@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787893192.662196:0:14440:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787893192.662308:0:14440:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:2.0:1787893192.662358:0:14440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4bdc1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.662375:0:14440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4bdc1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.662387:0:14440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4bdc1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.662396:0:14440:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4bdc1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.662402:0:14440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4bdc1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.662409:0:14440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4bdc1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.662441:0:14440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787893192.662562:0:14440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90713f90c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0bf598c2-503d-4eab-8bcc-148652504c30+19:14559:x1874741431501184:12345-192.168.202.29@tcp:35:lhsmtool_posix.0 Request processed in 1811us (2532us total) trans 8589934630 rc 0/0 00000100:00100000:2.0:1787893192.662576:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 13 00000020:00080000:2.0:1787893192.662581:0:14440:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787893192.662795:0:16140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787893192.662803:0:16140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4bdc1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893192.662821:0:16140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9fc00 already unused, calling callback (ffffffffc15e8230) 00010000:00010000:1.0:1787893192.662826:0:16140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4bdc1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893192.662834:0:16140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4bdc1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893192.662849:0:16140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff907105cffd00) 00010000:00010000:1.0:1787893192.662852:0:16140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787893192.662857:0:16140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4bdc1 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893192.662863:0:16140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4bdc1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14440 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787893192.662876:0:16140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893192.662878:0:16140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893192.662879:0:16140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787893192.666863:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893192.667013:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431501440 00000100:00100000:1.0:1787893192.667022:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431501440 00000100:00100000:1.0:1787893192.667080:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 14 00000100:00100000:1.0:1787893192.667090:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105af9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0bf598c2-503d-4eab-8bcc-148652504c30+19:14558:x1874741431501440:12345-192.168.202.29@tcp:35:bash.0 00000001:00080000:1.0:1787893192.667339:0:14441:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:1.0:1787893192.667483:0:14441:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:1.0:1787893192.667589:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105af9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0bf598c2-503d-4eab-8bcc-148652504c30+22:14558:x1874741431501440:12345-192.168.202.29@tcp:35:bash.0 Request processed in 500us (736us total) trans 8589934633 rc 0/0 00000100:00100000:1.0:1787893192.667598:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 14 00000020:00080000:1.0:1787893192.667610:0:14441:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1787893192.827006:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893192.827210:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431501696 00000100:00100000:2.0:1787893192.827221:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431501696 00000100:00100000:2.0:1787893192.827278:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 61 00000100:00100000:2.0:1787893192.827288:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137e4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bf598c2-503d-4eab-8bcc-148652504c30+22:14569:x1874741431501696:12345-192.168.202.29@tcp:101:lfs.0 00010000:00010000:2.0:1787893192.827326:0:14438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787893192.827348:0:14438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4bdc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b197ae6a821b434 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787893192.827623:0:14438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787893192.827858:0:14438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4bdc8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b434 expref: 24 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.827874:0:14438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff907105cff400) 00010000:00010000:2.0:1787893192.827877:0:14438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787893192.827883:0:14438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4bdc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.29@tcp remote: 0x6b197ae6a821b434 expref: 24 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.827897:0:14438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff907139b9fc00, rc 0) 00000100:00100000:2.0:1787893192.827958:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137e4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0bf598c2-503d-4eab-8bcc-148652504c30+23:14569:x1874741431501696:12345-192.168.202.29@tcp:101:lfs.0 Request processed in 671us (963us total) trans 8589934634 rc 301/301 00000100:00100000:2.0:1787893192.827965:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 61 00000100:00100000:3.0:1787893192.836789:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893192.836908:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431501824 00000100:00100000:2.0:1787893192.836919:0:14437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431501824 00000100:00100000:2.0:1787893192.836998:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 62 00000100:00100000:2.0:1787893192.837009:0:14437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137e48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bf598c2-503d-4eab-8bcc-148652504c30+23:14569:x1874741431501824:12345-192.168.202.29@tcp:34:lfs.0 00010000:00010000:2.0:1787893192.837096:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4bdd6 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.837113:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4bdd6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.837123:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4bdd6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.837152:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4bddd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.837160:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4bddd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.837167:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4bddd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.837850:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bde4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.837860:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bde4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.837868:0:14437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bde4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787893192.837909:0:14437:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bde4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.837921:0:14437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4bdd6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.837928:0:14437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4bdd6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.837935:0:14437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4bdd6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.837941:0:14437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9fc00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893192.837945:0:14437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4bdd6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.837962:0:14437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4bdd6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.837975:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff907104d8ef00) 00010000:00010000:2.0:1787893192.837989:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893192.837994:0:14437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4bdd6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.838000:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9fc00/0x825e3f5022b4bdd6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.838014:0:14437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4bddd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.838020:0:14437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4bddd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.838026:0:14437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4bddd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.838031:0:14437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9ea00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893192.838034:0:14437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4bddd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.838041:0:14437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4bddd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.838048:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff907105cff900) 00010000:00010000:2.0:1787893192.838050:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893192.838053:0:14437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4bddd lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.838275:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ea00/0x825e3f5022b4bddd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.838292:0:14437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bde4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.838297:0:14437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bde4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.838303:0:14437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bde4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.838308:0:14437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff907139b9ee00 already unused, calling callback (ffffffffc20274f0) 00010000:00010000:2.0:1787893192.838311:0:14437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bde4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.838317:0:14437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bde4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.838325:0:14437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9071061f7300) 00010000:00010000:2.0:1787893192.838327:0:14437:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787893192.838330:0:14437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bde4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787893192.838335:0:14437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff907139b9ee00/0x825e3f5022b4bde4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14437 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787893192.838587:0:14437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137e48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0bf598c2-503d-4eab-8bcc-148652504c30+23:14569:x1874741431501824:12345-192.168.202.29@tcp:34:lfs.0 Request processed in 1578us (2168us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893192.838597:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 62 00000100:00100000:0.0:1787893192.851180:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:1.0:1787893192.851491:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431502080 00000100:00100000:1.0:1787893192.851502:0:14441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431502080 00000100:00100000:1.0:1787893192.851566:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 15 00000100:00100000:1.0:1787893192.851576:0:14441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105af8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0bf598c2-503d-4eab-8bcc-148652504c30+23:14569:x1874741431502080:12345-192.168.202.29@tcp:35:lfs.0 00000100:00100000:1.0:1787893192.852435:0:14441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105af8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0bf598c2-503d-4eab-8bcc-148652504c30+24:14569:x1874741431502080:12345-192.168.202.29@tcp:35:lfs.0 Request processed in 858us (1262us total) trans 8589934635 rc 0/0 00000100:00100000:1.0:1787893192.852445:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 15 00010000:00010000:0.0:1787893192.971508:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893193.269579:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893193.269644:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893193.269689:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893193.269735:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893193.269794:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893193.269826:0:15850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431502720 00000100:00100000:3.0:1787893193.269835:0:15850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431502720 00000100:00100000:3.0:1787893193.269899:0:15850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431502336 00000100:00100000:3.0:1787893193.269903:0:15850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431502336 00000100:00100000:3.0:1787893193.269919:0:15850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431502592 00000100:00100000:3.0:1787893193.269922:0:15850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431502592 00000100:00100000:3.0:1787893193.269939:0:15850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 18 00000100:00100000:2.0:1787893193.270131:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 19 00000100:00100000:2.0:1787893193.270142:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137e49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0bf598c2-503d-4eab-8bcc-148652504c30+5:2362:x1874741431502336:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1787893193.270212:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137e49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0bf598c2-503d-4eab-8bcc-148652504c30+5:2362:x1874741431502336:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 73us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893193.270220:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 19 00000100:00100000:2.0:1787893193.270237:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 20 00000100:00100000:2.0:1787893193.270242:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137e49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:002066d6-fa17-4c0c-81b6-8973035fb81a+5:2362:x1874741431502592:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1787893193.270265:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137e49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:002066d6-fa17-4c0c-81b6-8973035fb81a+5:2362:x1874741431502592:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 22us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893193.270271:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 20 00000100:00100000:2.0:1787893193.270291:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431502464 00000100:00100000:2.0:1787893193.270294:0:14438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431502464 00000100:00100000:2.0:1787893193.270323:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 33 00000100:00100000:2.0:1787893193.270329:0:14438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137e4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:002066d6-fa17-4c0c-81b6-8973035fb81a+6:2362:x1874741431502464:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:2.0:1787893193.270359:0:14438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137e4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:002066d6-fa17-4c0c-81b6-8973035fb81a+6:2362:x1874741431502464:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 30us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893193.270366:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 33 00000100:00100000:3.0:1787893193.270627:0:15850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137e4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:002066d6-fa17-4c0c-81b6-8973035fb81a+5:2362:x1874741431502720:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:3.0:1787893193.270654:0:15850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137e4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:002066d6-fa17-4c0c-81b6-8973035fb81a+5:2362:x1874741431502720:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 33us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1787893193.270735:0:15850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 18 00000100:00100000:0.0:1787893193.270898:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431502208 00000100:00100000:0.0:1787893193.270903:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431502208 00000100:00100000:0.0:1787893193.270944:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 125 00000100:00100000:0.0:1787893193.270952:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907106341050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fa852aa-37e5-47a0-814e-47dc5f78a37a+13:2362:x1874741431502208:12345-192.168.202.29@tcp:400:kworker.0 00000100:00100000:0.0:1787893193.270996:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907106341050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5fa852aa-37e5-47a0-814e-47dc5f78a37a+13:2362:x1874741431502208:12345-192.168.202.29@tcp:400:kworker.0 Request processed in 45us (1429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787893193.271004:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 125 00000100:00080000:0.0:1787893193.271031:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787893193.271035:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787893193.271037:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787893193.421602:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787893193.421635:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff90713f90dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455599744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787893193.421711:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787893193.421931:0:15124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741455599744 00000100:00100000:1.0:1787893193.421940:0:15124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741455599744 00000100:00100000:1.0:1787893193.422002:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787893193.422012:0:15124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907105afb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455599744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787893193.422053:0:15124:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787893193.422114:0:15124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907105afb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874741455599744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787893193.422122:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787893193.424483:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff90713f90dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1874741455599744:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787893193.993916:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787893194.763643:0:16699:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:1.0:1787893195.023488:0:16140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787893195.863230:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:3.0:1787893195.863298:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.29@tcp (source: 12345-192.168.202.29@tcp) 00000100:00100000:2.0:1787893195.863444:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431502976 00000100:00100000:2.0:1787893195.863455:0:15120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431502976 00000100:00100000:2.0:1787893195.863622:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 20 00000100:00100000:2.0:1787893195.863634:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137e48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0bf598c2-503d-4eab-8bcc-148652504c30+8:2360:x1874741431502976:12345-192.168.202.29@tcp:16:kworker.0 00000100:00100000:2.0:1787893195.863786:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137e48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0bf598c2-503d-4eab-8bcc-148652504c30+8:2360:x1874741431502976:12345-192.168.202.29@tcp:16:kworker.0 Request processed in 121us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1787893195.863793:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 20 00000100:00080000:3.0:1787893195.863859:0:14433:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787893195.864400:0:15125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874741431502848 00000100:00100000:0.0:1787893195.864407:0:15125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874741431502848 00002000:00100000:0.0:1787893195.864437:0:15125:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff907137e4a300 x1874741431502848/t0(0) o4->0bf598c2-503d-4eab-8bcc-148652504c30@192.168.202.29@tcp:356/0 lens 504/0 e 0 to 0 dl 1787893206 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1787893195.864449:0:15125:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff907137e4a300 with x1874741431502848 ext(0->8) 00002000:00010000:0.0:1787893195.864455:0:15125:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff907137e4a300 00000100:00100000:0.0:1787893195.864504:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.29@tcp, seq: 0 00000100:00100000:0.0:1787893195.864513:0:15125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff907137e4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0bf598c2-503d-4eab-8bcc-148652504c30+8:2360:x1874741431502848:12345-192.168.202.29@tcp:4:bash.0 00000100:00100000:0.0:1787893195.865147:0:15125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff907137e4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0bf598c2-503d-4eab-8bcc-148652504c30+10:2360:x1874741431502848:12345-192.168.202.29@tcp:4:bash.0 Request processed in 633us (1926us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1787893195.865168:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.29@tcp, seq: 0 00002000:00100000:0.0:1787893195.865177:0:15125:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff907137e4a300 x1874741431502848/t8589934598(0) o4->0bf598c2-503d-4eab-8bcc-148652504c30@192.168.202.29@tcp:356/0 lens 504/448 e 0 to 0 dl 1787893206 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1787893195.865187:0:15125:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff907137e4a300 with x1874741431502848 ext(0->8) 00002000:00010000:0.0:1787893195.865190:0:15125:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff907137e4a300 00010000:00010000:0.0:1787893196.041171:0:14425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787893197.065092:0:14426:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 30035 lines, 30035 kept, 0 dropped, 0 bad.